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Why  GAO  Did  This  Study 

In  2006,  the  federal  government 
spent  $13  billion — 14  percent  of  its 
research  and  development  (R&D) 
expenditures — to  enable  38 
federally  funded  R&D  centers 
(FFRDCs)  to  meet  special  research 
needs.  FFRDCs — including 
laboratories,  studies  and  analyses 
centers,  and  systems  engineering 
centers — conduct  research  in 
military  space  programs, 
nanotechnology,  microelectronics, 
nuclear  warfare,  and  biodefense 
countermeasures,  among  other 
areas.  GAO  was  asked  to  identify 
(1)  how  federal  agencies  contract 
with  organizations  operating 
FFRDCs  and  (2)  agency  oversight 
processes  used  to  ensure  that 
FFRDCs  are  well-managed. 

GAO’s  work  is  based  on  a  review  of 
documents  and  interviews  with 
officials  from  eight  FFRDCs 
sponsored  by  the  departments  of 
Defense  (DOD),  Energy  (DOE), 
Health  and  Human  Services  (HHS), 
and  Homeland  Security  (DHS). 


What  GAO  Recommends 


To  improve  the  effectiveness  of 
FFRDCs,  GAO  recommends  that 
(1)  DHS  and  HHS  revise  their 
personal  conflict-of-interest 
policies  to  specifically  address 
FFRDC  contractor  employees  in  a 
position  to  influence  research 
findings  or  agency  decision  making 
and  (2)  agencies  create  an  ongoing 
forum  to  share  best  practices  for 
FFRDC  oversight.  DHS,  DOD,  and 
DOE  concurred  with  GAO’s 
recommendations,  while  HHS 
concurred  with  the  need  to  revise 
its  policies  and  is  considering  a 
best  practices  forum  for  FFRDCs. 

To  view  the  full  product,  including  the  scope 
and  methodology,  click  on  GAO-09-15. 

For  more  information,  contact  William  Woods, 
202-512-4841  woodsw@gao.gov  or  Anu 
Mittal,  202-512-9846,  mittala@gao.gov. 


What  GAO  Found 

Federal  agencies  GAO  reviewed  use  cost-reimbursement  contracts  with  the 
organizations  that  operate  FFRDCs,  and  three  of  the  agencies  generally  use 
full  and  open  competition  to  award  the  contracts.  Only  DOD  consistently 
awards  its  FFRDC  contracts  on  a  sole-source  basis,  as  permitted  by  law  and 
regulation  when  properly  justified.  FFRDCs  receive  funding  for  individual 
projects  from  customers  that  require  the  FFRDCs’  specialized  research 
capabilities.  Because  FFRDCs  have  a  special  relationship  with  their 
sponsoring  agencies  and  may  be  given  access  to  sensitive  or  proprietary  data, 
regulations  require  that  FFRDCs  be  free  from  organizational  conflicts  of 
interest.  DOD  and  DOE  also  have  policies  that  prescribe  specific  areas  that 
FFRDC  contractors  must  address  to  ensure  their  employees  are  free  from 
personal  conflicts  of  interest.  In  a  May  2008  report,  GAO  recognized  the 
importance  of  implementing  such  safeguards  for  contractor  employees. 
Currently,  although  DHS  and  HHS  have  policies  that  require  their  FFRDC 
contractors  to  implement  conflicts-of-interest  safeguards,  these  policies  lack 
the  specificity  needed  to  ensure  their  FFRDC  contractors  will  consistently 
address  employees’  personal  conflicts  of  interest. 

Sponsoring  agencies  use  various  approaches  in  their  oversight  of  FFRDC 
contractors,  including: 

•  Review  and  approval  of  work  assigned  to  FFRDCs,  or  conducted  for  other 
agencies  or  entities,  to  determine  consistency  with  the  FFRDC’s  purpose, 
capacity,  and  special  competency.  In  this  process,  only  DOD  must  abide 
by  congressionally  imposed  annual  workload  limits  for  its  FFRDCs. 

•  Conduct  performance  reviews  and  audits  of  contractor  costs,  finances, 
and  internal  controls. 

•  Conduct  a  comprehensive  review  before  a  contract  is  renewed  to  assess 
the  continuing  need  for  the  FFRDC  and  if  the  contractor  can  meet  that 
need,  based  on  annual  assessments  of  contractor  performance. 

Some  agencies  have  adopted  other  agencies’  FFRDC  oversight  and 
management  practices.  For  example,  DHS  mirrored  most  of  DOD’s  FFRDC 
Management  Plan — an  internal  DOD  guidance  document — in  developing  an 
approach  to  FFRDC  oversight,  and  DHS  officials  told  us  they  learned  from 
DOE’s  experience  in  selecting  and  overseeing  contractors  for  laboratory 
FFRDCs.  In  addition,  HHS  plans  to  implement  certain  DOE  practices, 
including  rewarding  innovation  and  excellence  in  performance  through 
various  contract  incentives.  While  agency  officials  have  acknowledged  the 
potential  benefits  from  sharing  best  practices,  there  is  currently  no  formal 
cross-agency  forum  or  other  established  mechanism  for  doing  so. 
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United  States  Government  Accountability  Office 
Washington,  DC  20548 


October  8,  2008 

The  Honorable  John  D.  Dingell 
Chairman 

The  Honorable  Joe  Barton 
Ranking  Member 

Committee  on  Energy  and  Commerce 
House  of  Representatives 

The  Honorable  Bart  T.  Stupak 
Chairman 

The  Honorable  John  M.  Shimkus 
Ranking  Member 

Subcommittee  on  Oversight  and  Investigations 
Committee  on  Energy  and  Commerce 
House  of  Representatives 

In  fiscal  year  2006,  the  federal  government  spent  $13  billion1 — 14  percent 
of  all  federal  research  and  development  expenditures — funding  work  at  its 
38  federally  funded  research  and  development  centers  (FFRDCs).  These 
centers  are  agency-sponsored2  entities  that  specialize  in  areas  such  as 
military  space  programs,  nanotechnology,  advanced  microelectronics  and 
semiconductors,  nuclear  warfare,  biodefense  countermeasures,  and  high- 
energy  particle  physics.  Sponsoring  agencies  contract  with  nonprofit, 
university-affiliated,  or  private  industry  organizations  to  operate  the 
FFRDCs.  Based  on  your  interest  in  how  FFRDCs  are  managed,  we 
identified  (1)  how  federal  agencies  contract  with  organizations  that 
operate  FFRDCs  and  (2)  the  oversight  processes  agencies  use  to  ensure 
that  FFRDCs  are  effectively  and  efficiently  managed. 

We  used  a  case  study  methodology  to  conduct  our  review.  We  chose  three 
agencies  with  a  long  histoiy  of  sponsoring  FFRDCs — the  departments  of 


'Data  from  the  National  Science  Foundation,  Science  and  Engineering  Indicators 
(2008) — the  latest  available. 

2“Sponsor”  means  the  executive  agency  that  manages,  administers,  monitors,  funds,  and  is 
responsible  for  the  overall  use  of  an  FFRDC.  Federal  Acquisition  Regulation  (FAR) 
35.017(b). 
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Defense  (DOD),  Energy3  (DOE),  and  Health  and  Human  Services  (HHS) — 
as  well  as  a  fourth  agency  that  has  more  recently  established  FFRDCs — 
the  Department  of  Homeland  Security  (DHS).  From  the  29  FFRDCs  that 
these  four  agencies  sponsor,  we  selected  a  nongeneralizable  sample  of 
eight  FFRDCs  for  in-depth  review.  We  made  our  selections  to  achieve 
variation,  both  among  the  type  of  FFRDC  (scientific  laboratories  versus 
other  types)  and  the  type  of  operating  contractor  (universities,  nonprofits, 
and  private  industry).  For  each  of  the  four  federal  agencies,  we 
interviewed  officials  at  the  office  that  sponsors  FFRDCs  as  well  as  those 
officials  who  have  contract  management  or  audit  roles.  We  analyzed 
regulations,  policies,  guidance,  contracts,  sponsoring  agreements,  and 
other  documentation.  For  the  eight  FFRDCs  in  our  case  study,  we 
conducted  site  visits,  interviewed  key  contractor  personnel,  and  obtained 
information  and  documentation  on  how  they  met  sponsoring  agencies’ 
research  needs  and  adhere  to  requirements.  For  additional  information  on 
our  scope  and  methodology,  see  appendix  I. 

We  conducted  this  performance  audit  from  October  2007  to  October  2008, 
in  accordance  with  generally  accepted  government  auditing  standards. 
Those  standards  require  that  we  plan  and  perform  the  audit  to  obtain 
sufficient,  appropriate  evidence  to  provide  a  reasonable  basis  for  our 
findings  and  conclusions  based  on  our  audit  objectives.  We  believe  that 
the  evidence  obtained  provides  a  reasonable  basis  for  our  findings  and 
conclusions  based  on  our  audit  objectives. 


Results  in  Brief 


The  federal  agencies  we  reviewed  use  cost-reimbursement  contracts  with 
the  organizations  that  operate  their  FFRDCs,  and  three  of  the  four 
agencies  generally  use  full  and  open  competition  to  award  these  contracts. 
Only  DOD  has  consistently  awarded  its  FFRDC  contracts  on  a  sole-source 
basis,  a  practice  that  federal  law  and  regulations  permit  if  properly 
justified.  The  FFRDCs  receive  funding  on  a  project-by-project  basis  from 
customers  requiring  the  FFRDCs’  research  and  development  capabilities. 
In  order  to  carry  out  these  projects,  FFRDCs  frequently  are  provided  with 
access  to  sensitive  or  proprietary  data.  For  this  reason,  and  because  of  the 
special  relationship  between  sponsoring  agencies  and  their  FFRDCs, 
federal  regulations  require  that  FFRDC  entities  be  free  from  organizational 


References  to  DOE  in  this  report  include  the  National  Nuclear  Security  Administration,  a 
separately  organized  agency  within  DOE  that  is  responsible  for  the  management  and 
security  of  the  nation’s  nuclear  weapons,  nuclear  nonproliferation,  and  naval  reactor 
programs. 
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conflicts  of  interest.  While  the  sponsoring  agreements  we  reviewed 
address  FFRDCs’  organizational  conflicts  of  interest,  DOD  and  DOE  also 
have  policies  that  prescribe  specific  areas  that  FFRDC  contractors  must 
address  to  ensure  their  employees  are  free  from  personal  conflicts  of 
interest.  In  a  May  2008  report,  we  recognized  the  importance  of 
implementing  such  safeguards  for  certain  contractor  employees. 

Currently,  although  DHS’s  FFRDC  contractors  have  their  own  internal 
policies  that  address  employees’  potential  conflicts  of  interest,  DHS  and 
HHS  policies  do  not  specifically  prescribe  areas  that  FFRDC  contractors 
must  include  to  address  these  conflicts.- 

The  four  sponsoring  agencies  use  various  approaches  in  their  oversight  of 
FFRDC  contractors.  First,  sponsors  review  and  approve  the  work  assigned 
to  their  FFRDCs  to  ensure  it  is  within  their  purpose,  mission,  capacity,  and 
special  competency.  In  this  process,  DOD  is  the  only  agency  that  operates 
under  congressionally  imposed  annual  workload  limits  for  its  FFRDCs.  In 
addition,  agencies  regularly  assess  the  performance  of  their  FFRDCs  and 
contractors,  including  in  some  cases,  performing  audits  of  contractor 
costs,  finances,  and  internal  controls.  Finally,  in  accordance  with  federal 
regulations,  agencies  conduct  comprehensive  reviews  prior  to  renewing 
sponsoring  agreements  or  contracts  to  assess  the  continued  research  need 
and  the  management  and  competencies  of  the  FFRDCs.  In  conducting 
oversight,  some  agencies  have  adopted  elements  of  the  oversight  practices 
used  by  other  sponsoring  agencies.  For  example,  DHS  mirrored  most  of 
DOD’s  FFRDC  Management  Plan — an  internal  DOD  guidance  document — 
and  DHS  officials  told  us  they  learned  from  DOE’s  experience  in  selecting 
and  overseeing  contractors  for  laboratory  FFRDCs.  In  addition,  HHS  plans 
to  implement  certain  DOE  practices,  including  rewarding  innovation  and 
excellence  in  performance  through  incentive  fees  and  award  terms.  While 
agency  officials  have  noted  potential  benefits  from  sharing  best  practices, 
there  is  currently  no  formal  cross-agency  forum  or  other  established 
mechanism  for  doing  so. 

To  improve  the  effectiveness  of  FFRDC  management,  we  are 
recommending  that  (1)  DHS  and  HHS  review  and  revise  personal  conflict- 
of-interest  policies  to  ensure  they  specifically  address  FFRDC  employees 
in  a  position  to  make  or  influence  research  findings  or  agency  decision 
making  and  (2)  the  four  agencies  we  reviewed  establish  an  ongoing  forum 
to  share  best  practices  for  FFRDC  oversight.  In  commenting  on  a  draft  of 
this  report,  DHS  and  HHS  concurred  with  our  recommendation  that  they 
review  and  revise  their  conflict  of  interest  policies.  In  addition,  DOD,  DOE, 
and  DHS  all  concurred  with  our  recommendation  to  establish  a  forum  to 
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share  best  practices,  while  HHS  is  considering  participation  in  such  a 
forum. 

Background 

During  World  War  II,  the  U.S.  government  partnered  with  academic 
scientists  in  ad-hoc  laboratories  and  research  groups  to  meet  unique 
research  and  development  (R&D)  needs  of  the  war  effort.  These  efforts 
resulted  in  technologies  such  as  the  proximity  fuse,  advanced  radar  and 
sonar,  and  the  atomic  bomb.  Those  relationships  were  later  re-structured 
into  federal  research  centers  to  retain  academic  scientists  in  U.S.  efforts  to 
continue  advancements  in  technology,  and  by  the  mid-1960’s  the  term 
“federally  funded  research  and  development  centers”  was  applied  to  these 
entities.  Since  that  time,  the  U.S.  government  has  continued  to  rely  on 
FFRDCs  to  develop  technologies  in  areas  such  as  combating  terrorism  and 
cancer,  addressing  energy  challenges,  and  tackling  evolving  challenges  in 
air  travel.4  For  example,  one  of  DOE’s  laboratories  was  used  to  invent  and 
develop  the  cyclotron,  which  is  a  particle  accelerator  that  produces  high 
energy  beams,  critical  to  the  field  of  nuclear  physics  for  the  past  several 
decades. 

Today,  FFRDCs  support  their  sponsoring  federal  agencies  in  diverse  fields 
of  study.  For  example,  DOE  sponsors  the  most  FFRDCs — 16  in  total — all 
of  which  are  research  laboratories  that  conduct  work  in  such  areas  as 
nuclear  weapons,  renewable  energy  sources,  and  environmental 
management.  DHS  recently  established  two  FFRDCs:  one  to  develop 
countermeasures  for  biological  warfare  agents  and  the  other  to  provide 
decision  makers  with  advice  and  assistance  in  such  areas  as  analysis  of  the 
vulnerabilities  of  the  nation’s  critical  infrastructures,  standards  for 
interoperability  for  field  operators  and  first  responders,  and  evaluating 
developing  technologies  for  homeland  security  purposes. 

FFRDCs  are  privately  owned  but  government-funded  entities  that  have 
long-term  relationships  with  one  or  more  federal  agencies  to  perform 
research  and  development  and  related  tasks.  Even  though  they  may  be 
funded  entirely,  or  nearly  so,  from  the  federal  treasury,  FFRDCs  are 
regarded  as  contractors  not  federal  agencies.  In  some  cases,  Congress  has 
specifically  authorized  agencies  to  establish  FFRDCs.  For  example,  the 

4For  a  brief  overview  of  the  evolution  and  legal  framework  applicable  to  FFRDCs,  see  GAO, 
Principles  of  Federal  Appropriations  Law,  vol.  4,  2nd  ed.,  GAO-01-179SP  (Washington, 
D.C.:  March  2001),  pp.  17-81  through  17-85. 
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1991  appropriation  for  the  Internal  Revenue  Service  authorized  the  IRS  to 
spend  up  to  $15  million  to  establish  an  FFRDC  as  part  of  its  tax  systems 
modernization  program.5 

According  to  the  Federal  Acquisition  Regulation  (FAR),  FFRDCs  are 
intended  to  meet  special  long-term  research  or  development  needs  that 
cannot  be  met  as  effectively  by  existing  in-house  or  contractor  resources. 
In  sponsoring  an  FFRDC,  agencies  draw  on  academic  and  private  sector 
resources  to  accomplish  tasks  that  are  integral  to  the  mission  and 
operation  of  the  sponsoring  agency.  In  order  to  discharge  responsibilities 
to  their  sponsoring  agencies,  the  FAR  notes  that  FFRDCs  have  special 
access,  beyond  that  which  is  common  for  normal  contractual 
relationships,  to  government  and  supplier  data — including  sensitive  and 
proprietary  data — and  other  government  resources.  Furthermore,  the  FAR 
requires  FFRDCs  to  operate  in  the  public  interest  with  objectivity  and 
independence,  to  be  free  of  organizational  conflicts  of  interest,  and  to  fully 
disclose  their  affairs  to  the  sponsoring  agencies.6  FFRDCs  may  be 
operated  by  a  university  or  consortium  of  universities;  other  nonprofit 
organizations;  or  a  private  industry  contractor  as  an  autonomous 
organization  or  a  separate  unit  of  a  parent  organization. 

Agencies  develop  sponsoring  agreements  with  FFRDCs  to  establish  their 
research  and  development  missions  and  prescribe  how  they  will  interact 
with  the  agency;  the  agencies  then  contract  with  organizations  to  operate 
the  FFRDCs  to  accomplish  those  missions.  At  some  agencies  the 
sponsoring  agreement  is  a  separate  document  that  is  incorporated  into  the 
contract,  and  at  other  agencies  the  contract  itself  constitutes  the 
sponsoring  agreement.  The  sponsoring  agreement  and  contract  together 
identify  the  scope,  purpose,  and  mission  of  the  FFRDC  and  the 
responsibilities  of  the  contractor  in  ensuring  they  are  accomplished  by  the 
FFRDC. 

Although  the  contract  or  sponsoring  agreement  may  take  various  forms, 
the  FAR  requires  FFRDC  sponsoring  agreements  to  contain  certain  key 
terms  and  conditions.7  For  example,  the  agreement  term  may  not  exceed  5 
years,  but  can  be  periodically  renewed  in  increments  not  to  exceed  5 


5Pub.  L.  No.  101-509  (1990). 

6FAR  35.017(a)(2). 

'FAR  35.017-1,  Sponsoring  Agreements. 
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years.  Sponsoring  agreements  must  also  contain  prohibitions  against  the 
FFRDCs  competing  with  non-FFRDCs  in  response  to  a  federal  agency 
request  for  proposals  for  other  than  the  operation  of  an  FFRDC.  The 
agreement  also  must  delineate  whether  and  under  what  circumstances  the 
FFRDC  may  accept  work  from  other  agencies.  In  addition,  these 
agreements  may  identify  cost  elements  requiring  advance  agreement  if 
cost-type  contracts  are  used  and  include  considerations  affecting 
negotiation  of  fees  where  fees  are  determined  appropriate  by  sponsors. 

The  National  Science  Foundation  (NSF),  which  keeps  general  statistics  on 
FFRDCs,  identifies  the  following  types  of  FFRDCs: 

•  Research  and  development  (R&D)  laboratories:  fill  voids  where  in-house 
and  private  sector  R&D  centers  are  unable  to  meet  core  agency  needs. 
These  FFRDCs  are  used  to  maintain  long-term  competency  in 
sophisticated  technology  areas  and  develop  and  transfer  important  new 
technology  to  the  private  sector. 

•  Study  and  analysis  centers:  used  to  provide  independent  analyses  and 
advice  in  core  areas  important  to  their  sponsors,  including  policy 
development,  support  for  decision  making,  and  identifying  alternative 
approaches  and  new  ideas  on  significant  issues. 

•  Systems  engineering  and  integration  centers:  provide  support  for  complex 
systems  by  assisting  with  the  creation  and  choice  of  system  concepts  and 
architectures,  the  specification  of  technical  system  and  subsystem 
requirements  and  interfaces,  the  development  and  acquisition  of  system 
hardware  and  software,  the  testing  and  verification  of  performance,  the 
integration  of  new  capabilities,  and  continuous  improvement  of  system 
operations  and  logistics. 

The  NSF  maintains  a  master  list8  of  the  current  FFRDCs  and  collects 
funding  data  from  their  agency  sponsors  on  an  annual  basis.  According  to 
NSF  data,  R&D  funding  for  FFRDCs  has  risen  steadily  across  the  federal 
government,  increasing  40  percent  from  fiscal  year  1996  to  2006,  from  $6.9 
billion  to  $9.7  billion.  (See  fig.  1  below.)  This  does  not  represent  the  full 
amount  of  funding  provided  to  FFRDCs  by  federal  agencies,  however, 
since  it  does  not  include  non-R&D  funding.  Nevertheless,  it  is  the  only 
centrally  reported  information  on  federal  funding  for  FFRDCs. 


8http://www.nsf.gov/statistics/ffrdc/  (last  accessed  Oct.  3,  2008). 
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Figure  1:  Federal  R&D  Funding  for  FFRDCs 

In  fiscal  year  2008  dollars  (in  billions) 

12 

11 

10 


Source:  GAO  analysis  of  National  Science  Foundation  data. 

For  a  list  of  the  38  FFRDCs  currently  sponsored  by  the  U.S.  government, 
see  appendix  II. 


Most  Agencies 
Compete  Cost- 
Reimbursement 
Contracts  for 
Operating  Their 
FFRDCs,  but  Some 
Do  Not  Have  Specific 
Personal  Conflict-of- 
interest  Requirements 


The  four  agencies  we  reviewed  use  cost-reimbursement  contracts  with  the 
organizations  that  operate  their  FFRDCs,  and  three  of  these  agencies 
generally  use  full  and  open  competition  in  awarding  these  contracts.  While 
the  agencies  require  that  their  FFRDCs  be  free  from  organizational 
conflicts  of  interest  in  accordance  with  federal  regulations,  only  DOD  and 
DOE  have  agencywide  requirements  that  prescribe  specific  areas  that 
FFRDC  contractors  must  address  to  ensure  their  employees  are  free  from 
personal  conflicts  of  interest.  DHS  and  HHS  policies  do  not  specifically 
prescribe  areas  that  contractors  must  include  to  address  these  conflicts. 
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Three  Agencies  Generally 
Compete  FFRDC 
Contracts,  While  DOD 
Does  Not 


Federal  law  and  regulations  require  federal  contracts  to  be  competed 
unless  they  fall  under  specific  exceptions  to  full  and  open  competition. 
One  such  exception  is  awarding  contracts  to  establish  or  maintain  an 
essential  engineering,  research,  or  development  capability  to  be  provided 
by  an  FFRDC.9  While  some  agencies  we  reviewed  awarded  FFRDC 
contracts  through  other  than  full  and  open  competition  in  the  past, 
including  sole-source  contracts,  three  have  generally  used  full  and  open 
competition  in  recent  years. 


Starting  in  the  mid-1990’s,  DOE  took  steps  to  improve  FFRDC  laboratory 
contractors’  performance  with  a  series  of  contracting  reforms,  including 
increasing  the  use  of  competition  in  selecting  contractors  for  its  labs. 
Subsequent  legislation10  required  DOE  to  compete  the  award  and 
extension  of  contracts  used  at  its  labs,  singling  out  the  Ames  Laboratory, 
Argonne  National  Laboratory,  Lawrence  Berkeley  National  Laboratory, 
Lawrence  Livermore  National  Laboratory,  and  Los  Alamos  National 
Laboratory  for  mandatory  competition  because  their  contracts  in  effect  at 
the  time  had  been  awarded  more  than  50  years  ago.  In  addition,  according 
to  DOE  officials,  the  Los  Alamos  contract  was  competed  due  to 
performance  concerns  with  the  contractor,  and  Argonne  West’s  contract 
was  competed  to  combine  its  research  mission  with  that  of  the  Idaho 
National  Engineering  and  Environmental  Laboratory  to  form  the  Idaho 
National  Laboratory.  DOE  now  routinely  uses  competitive  procedures  on 
contracts  for  its  FFRDC  laboratories  unless  a  justification  for  the  use  of 
other  than  competitive  procedures  is  approved  by  the  Secretary  of  Energy. 
Of  DOE’s  16  FFRDCs,  DOE  has  used  full  and  open  competition  in  the 
award  of  13  contracts,  is  in  the  process  of  competing  one  contract,  and 
plans  to  compete  the  remaining  two  contracts  when  their  terms  have  been 
completed.  For  the  13  contracts  that  have  been  competed,  in  2  cases  the 
incumbent  contractor  received  the  new  contract  award,  in  8  cases  a  new 
consortium  or  limited  liability  corporation  was  formed  that  included  the 
incumbent  contractor,  and  in  3  cases  a  different  contractor  was  awarded 
the  contract. 


9See  10  U.S.C.  §  2304(c)(3);  41  U.S.C.  §  253(c)(3);  FAR  6.302-3(a)  (2)(ii). 

10The  Energy  and  Water  Development  Appropriations  Act,  2004  (Pub.  L.  No.  108-137,  §  301), 
requires  DOE  to  compete  its  management  and  operations  (M&O)  contracts,  the  contract 
type  DOE  uses  at  its  labs,  unless  the  Secretary  of  Energy  waives  the  requirement  and 
notifies  the  Energy  and  Water  Subcommittees  60  days  prior  to  contract  award. 
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Other  agencies  also  have  used  competitive  procedures  to  award  FFRDC 
contracts: 

•  HHS  has  conducted  full  and  open  competition  on  the  contract  for  its 
cancer  research  lab  since  its  establishment  in  1972, 11  resulting  in  some 
change  in  contractors  over  the  years.  Recently,  however,  HHS 
noncompetitively  renewed  the  contract  with  the  incumbent  contractor. 

The  last  time  it  was  competed,  in  2001,  HHS  received  no  offers  other  than 
SAIC-Frederick,  which  has  performed  the  contract  satisfactorily  since 
then.  HHS  publicly  posted  in  FedBizOpps  its  intention  to  noncompetitively 
renew  the  operations  and  technical  support  contract  with  SAIC-Frederick 
for  a  potential  10-year  period.  Interested  parties  were  allowed  to  submit 
capability  statements,  but  despite  some  initial  interest  none  were 
submitted. 

•  DHS  competed  the  initial  contract  awards  for  the  start  up  of  its  two 
FFRDCs,  with  the  award  of  the  first  contract  in  2004.  DHS  plans  to 
compete  the  award  of  the  next  studies  and  analyses  FFRDC  contract  this 
year. 

In  contrast,  DOD  continues  to  award  its  FFRDC  contracts  on  a  sole-source 
basis  under  statutory  exemptions  to  competition.  In  the  early  1990s,  a 
report  by  a  Senate  subcommittee12  and  a  Defense  Science  Board  task  force 
both  criticized  DOD’s  management  and  use  of  its  FFRDCs,  including  a  lack 
of  competition  in  contract  award.  This  criticism  mirrored  an  earlier  GAO 
observation.13  GAO  subsequently  noted  in  a  1996  report,  however,  that 
DOD  had  begun  to  strengthen  its  process  for  justifying  its  use  of  FFRDCs 
under  sole-source  contracts  for  specific  purposes.14  DOD  plans  to  continue 


uThe  lab  was  subsequently  designated  as  an  FFRDC  in  1975. 

^Subcommittee  on  Oversight  of  Government  Management,  Committee  on  Governmental 
Affairs,  U.S.  Senate.  Ina  dequate  Federal  Overs  ight  of  Federally  Funded  Research  and 
Development  Centers,  July  1992. 

13GAO  had  reported  in  1988,  that  full  and  open  competition  between  FFRDCs  and  non- 
FFRDCs  could  provide  some  assurance  that  sponsors  had  selected  the  most  effective 
source  for  the  work.  The  report  also  stated,  however,  that  exposing  FFRDCs  to 
marketplace  competition  could  fundamentally  alter  the  character  of  the  special 
relationship  between  FFRDCs  and  their  sponsors.  GAO,  Competition:  Issues  on 
Establishing  and  Using  Federally  Funded  Research  and  Development  Centers, 

GAO/N SIAD-88-22  (Washington,  D.C.:  March  1988). 

14GAO,  Federally  Funded  R&D  Centers:  Issues  Related  to  the  Management  of  DOD- 
Sponsored  Centers.  GAO/NSIAD-96-112  (Washington,  D.C.:  Aug.  6,  1996). 
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its  sole-source  contracting  for  the  three  FFRDC  contracts  that  are  due  for 
renewal  in  2008  and  the  six  contracts  to  be  renewed  in  2010. 


Agencies  Use  Cost- 
Reimbursement  Contracts 
with  Varying  Types  of  Fee 
Structures,  Primarily 
Funded  through  Program 
Offices 


All  of  the  FFRDC  contracts  we  reviewed  were  cost-reimbursement 
contracts,15  most  of  which  provided  for  payments  of  fixed,  award,  or 
incentive  fees  to  the  contractor  in  addition  to  reimbursement  of  incurred 
costs.  Fixed  fees  often  are  used  when,  according  to  the  agencies  we 
reviewed,  the  FFRDC  will  need  working  capital  or  other  miscellaneous 
expense  requirements  that  cannot  be  covered  through  reimbursing  direct 
and  indirect  costs.  Fixed  fees  generally  account  for  a  small  percentage  of 
the  overall  contract  costs;  for  fiscal  year  2007  fixed  fees  paid  to  the 
FFRDCs  we  reviewed  vary  from  a  low  of  about  0.1  percent  to  a  high  of  3 
percent.  Award  or  incentive  fees,  on  the  other  hand,  are  intended  to 
motivate  contractors  toward  such  areas  as  excellent  technical 
performance  and  cost  effective  management.16  These  types  of 
performance-based  fees  ranged  from  1  to  7  percent  at  the  agencies  we 
reviewed. 


Among  agencies  we  reviewed,  contract  provisions  on  fees  varied 
significantly: 

•  Most  DOD  contracts  are  cost-plus-fixed-fee,17  and  DOD,  as  a  general  rule, 
does  not  provide  award  or  incentive  fees  to  its  FFRDCs.  DOD’s  FFRDC 
management  plan — its  internal  guidance  document  for  DOD  entities  that 
sponsor  FFRDCs — limits  fees  to  amounts  needed  to  fund  ordinary  and 
necessary  business  expenses  that  may  not  be  otherwise  recoverable  under 
the  reimbursement  rules  that  apply  to  these  types  of  contracts.  For 
example,  the  FFRDC  operator  may  incur  a  one-time  expense  to  buy  an 
expensive  piece  of  needed  equipment,  but  the  government’s 
reimbursement  rules  require  that  this  expense  be  recovered  over  several 
future  years  in  accordance  with  an  amortization  schedule.  DOD’s 


15Cost-reimbursement  contracts — which  the  FAR  generally  considers  to  be  the  usually 
appropriate  contract  form  for  R&D — provide  for  payment  of  allowable  direct  and  indirect 
incurred  costs  as  prescribed  in  the  contract.  These  contracts  establish  an  estimate  of  total 
cost  to  obligate  funds  and  establish  a  ceiling  that  the  contractor  may  not  exceed  without 
contracting  officer  approval. 

16See  FAR  subparts  16.3  and  16.4. 

"According  to  FAR  subpart  16.3,  a  cost-plus-fixed-fee  contract  is  a  cost-reimbursement 
contract  that  provides  for  payment  to  the  contractor  of  a  negotiated  fee  that  is  fixed  at  the 
inception  of  the  contract.  The  fixed  fee  does  not  vary  with  actual  cost,  but  may  be  adjusted 
as  a  result  of  changes  in  the  work  to  be  performed  under  the  contract. 
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management  plan  indicates  that  fees  are  necessary  in  such  instances  to 
enable  the  contractor  to  service  the  debt  incurred  to  buy  the  equipment 
and  maintain  the  cash  flow  needed  for  the  contractor’s  business 
operations.  DOD  officials  told  us  they  scrutinize  these  fees  carefully  and 
do  not  always  pay  them.  For  example,  the  contract  between  DOD  and  the 
Massachusetts  Institute  of  Technology  (MIT),  which  operates  the  Lincoln 
Laboratory  FFRDC,  specifies  that  MIT  will  not  receive  such  fees. 

•  DOE  and  DHS  use  fixed  fees,  performance-based  fees,  and  award  terms, 
which  can  extend  the  length  of  the  contract  as  a  reward  for  good 
performance.  For  example,  Sandia  Corporation,  a  private  company  that 
operates  Sandia  National  Laboratories,  receives  both  a  fixed  fee  and  an 
incentive  fee,  which  for  fiscal  year  2007  together  amounted  to  about  $23.2 
million,  an  additional  1  percent  beyond  its  estimated  contract  cost.  In 
addition,  Sandia  Corporation  has  received  award  terms  that  have 
lengthened  its  contract  by  10  years. 

•  HHS  provides  only  performance-based  fees  to  the  private  company  that 
operates  its  one  FFRDC. 

Rather  than  receiving  direct  appropriations,  most  FFRDCs  are  funded  on  a 
project-by-project  basis  by  the  customers,  either  within  or  outside  of  the 
sponsoring  agency,  that  wish  to  use  their  services  by  using  funds  allocated 
to  a  program  or  office.  FFRDC  contracts  generally  specify  a  total 
estimated  cost  for  work  to  be  performed  and  provide  for  the  issuance  of 
modifications  or  orders  for  the  performance  of  specific  projects  and  tasks 
during  the  period  of  the  contract. 

Congressional  appropriations  conferees  sometimes  directed  specific 
funding  for  some  DHS  and  DOD  FFRDCs  in  conference  reports 
accompanying  sponsoring  agencies’  appropriations.  For  example, 
although  according  to  DOD  officials,  97  percent  of  its  FFRDC  funding 
comes  from  program  or  office  allocations  to  fund  specific  projects,  half  of 
its  FFRDCs  receive  some  directed  amounts  specified  in  connection  with 
DOD’s  annual  appropriations  process.  Specifically,  for  fiscal  year  2008,  the 
following  DOD  FFRDCs  received  conferee-directed  funding  in  the  DOD 
appropriations  conference  report:  MIT  Lincoln  Laboratory  Research 
Program,  $30  million;  the  Software  Engineering  Institute,  $26  million;  the 
Center  for  Naval  Analyses,  $49  million;  the  RAND  Project  Air  Force,  $31 
million;18  and  the  Arroyo  Center,  $20  million.  In  addition,  DOD  officials 


18This  accounts  for  about  75  percent  of  Project  Air  Force’s  annual  funding. 
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noted  that  the  congressional  defense  committees  sometimes  direct  DOD’s 
FFRDCs  to  perform  specific  studies  for  these  committees  through 
legislation  or  in  committee  reports.  In  fiscal  year  2008,  two  DOD  FFRDCs 
conducted  16  congressionally  requested  studies. 


All  Four  Agencies  Address 
Organizational  Conflicts  of 
Interest  but  Vary  in 
Addressing  Personal 
Conflicts  of  Interest  of 
FFRDC  Employees 


As  FFRDCs  may  have  access  to  sensitive  and  proprietary  information  and 
because  of  the  special  relationship  between  sponsoring  agencies  and  their 
FFRDCs,  the  FAR  requires  that  FFRDC  contractors  be  free  from 
organizational  conflicts  of  interest.  In  addition,  we  recently  reported  that, 
given  the  expanding  roles  that  contractor  employees  play,  government 
officials  from  the  Office  of  Government  Ethics  and  DOD  believe  that 
current  requirements  are  inadequate  to  address  potential  personal 
conflicts  of  interest  of  contractor  employees  in  positions  to  influence 
agency  decisions.19  While  each  agency  we  reviewed  requires  FFRDC 
operators  to  be  free  of  organizational  conflicts  of  interest,  DOD  and  DOE 
prescribe  specific  areas  that  FFRDC  contractors  must  address  to  ensure 
their  employees  are  free  from  personal  conflicts  of  interest. 


The  FAR  states  that  an  organizational  conflict  of  interest  exists  when 
because  of  other  interests  or  relationships,  an  entity  is  unable  or 
potentially  unable  to  render  impartial  assistance  or  advice  to  the 
government  or  the  entity  might  have  an  unfair  competitive  advantage. 
Because  sponsors  rely  on  FFRDCs  to  give  impartial,  technically  sound, 
objective  assistance  or  advice,  FFRDCs  are  required  to  conduct  their 
business  in  a  manner  befitting  their  special  relationship  with  the 
government,  to  operate  in  the  public  interest  with  objectivity  and 
independence,  to  be  free  from  organizational  conflicts  of  interest,  and  to 
fully  disclose  their  affairs  to  the  sponsoring  agency.20  Each  sponsoring 
agency  we  reviewed  included  conflict-of-interest  clauses  in  its  sponsoring 
agreements  with  contractors  operating  their  FFRDCs.  For  example,  a  DHS 
FFRDC  contract  includes  a  clause  that  specifically  prohibits  contractors 
that  have  developed  specifications  or  statements  of  work  for  solicitations 
from  performing  the  work  as  either  a  prime  or  first-tier  subcontractor. 

In  addition  to  organizational  conflicts  of  interest  requirements,  DOD  and 
DOE  have  specific  requirements  for  their  FFRDC  contractors  to  guard 
against  personal  conflicts  of  interest  of  their  employees.  For  purposes  of 


19GAO,  Defense  Contracting:  Addi  tional  Personal  Conflict  of  Interest  Safeguards  Needed 
for  Certain  DOD  Contractor  Employees,  GAO-08-169  (Washington,  D.C.:  Mar.  7,  2008). 

20FAR  35.017(a)(2);  35.017-2(h). 
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this  report,  a  personal  conflict  of  interest  may  occur  when  an  individual 
employed  by  an  organization  is  in  a  position  to  materially  influence  an 
agency’s  recommendations  and/or  decisions  and  who — because  of  his  or 
her  personal  activities,  relationships,  or  financial  interests — may  either 
lack  or  appear  to  lack  objectivity  or  appear  to  be  unduly  influenced  by 
personal  financial  interests.  In  January  2007,  the  Under  Secretary  of 
Defense  (Acquisition,  Technology,  and  Logistics)  implemented  an  updated 
standard  conflict-of-interest  policy  for  all  of  DOD’s  FFRDCs  that  requires 
FFRDC  contractors  to  establish  policies  to  address  major  areas  of 
personal  conflicts  of  interest  such  as  gifts,  outside  activities,  and  financial 
interests.  The  updated  policy  and  implementing  procedures  now  are 
included  in  all  DOD  FFRDC  sponsoring  agreements  and  incorporated  into 
the  DOD  FFRDC  operating  contracts.  This  action  was  prompted  by  public 
and  congressional  scrutiny  of  a  perceived  conflict  of  interest  by  the 
president  of  a  DOD  FFRDC  who  then  voluntarily  resigned.21  As  a  result, 
DOD’s  Deputy  General  Counsel  (Acquisition  and  Logistics)  reviewed  the 
conflict  of  interest  policies  and  procedures  in  place  at  each  of  its  FFRDCs 
and  determined  that  although  sponsoring  agreements,  contracts,  and 
internal  policies  were  adequate,  they  should  be  revised  to  better  protect 
DOD  from  employee-related  conflicts.  DOD’s  revised  policy  states  that 
conflicts  of  interest  could  diminish  an  FFRDC’s  objectivity  and  capacity  to 
give  impartial,  technically  sound,  objective  assistance  or  advice,  which  is 
essential  to  the  research,  particularly  with  regard  to  FFRDCs’  access  to 
sensitive  information.  Therefore,  the  policy  provides  that  FFRDC  conflict 
of  interest  policies  address  such  issues  as  gifts  and  outside  activities  and 
requires  an  annual  submission  of  statements  of  financial  interests  from  all 
FFRDC  personnel  in  a  position  to  make  or  materially  influence  research 
findings  or  recommendations  that  might  affect  outside  interests. 


21In  September  2006,  the  president  and  trustee  of  the  Institute  for  Defense  Analyses 
resigned  before  it  was  determined  by  DOD’s  Inspector  General  that  his  position  on  two 
defense  subcontractors’  corporate  boards  violated  the  FFRDC’s  conflicts-of-interest  policy. 
In  July  2006,  his  dual  roles  as  FFRDC  president  and  as  a  member  of  one  of  the  defense 
subcontractor’s  board  of  directors  drew  public  and  congressional  scrutiny  regarding  a 
business  case  for  the  Air  Force  on  a  multiyear  procurement  of  the  F-22  Raptor  aircraft. 
Because  this  subcontractor  manufactures  a  missile  launcher  for  the  F-22  aircraft’s  prime 
contractor,  conflict  of  interest  concerns  were  raised  that  the  FFRDC  president  stood  to 
financially  profit  from  a  favorable  multiyear  procurement  decision  for  the  F-22. 
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DOE’s  FFRDCs,  which  operate  under  management  and  operating  (M&O)  22 
contracts — a  special  FAR  designation  for  government-owned,  contractor- 
operated  facilities  such  as  DOE’s — have  additional  provisions  for 
addressing  personal  conflicts  of  interest.  The  provisions  address  such 
areas  as  reporting  any  outside  employment  that  may  constitute  a  personal 
conflict  of  interest.23  In  addition,  the  National  Nuclear  Security 
Administration  (NNSA),  which  sponsors  three  of  DOE’s  FFRDCs,  is 
planning  to  implement  additional  requirements  in  its  laboratory  contracts 
later  this  year  requiring  contractors  to  disclose  all  employee  personal 
conflict  of  interests,  not  just  outside  employment  as  is  currently  required. 
An  NNSA  procurement  official  noted  that  other  personal  conflict  of 
interests  may  include  any  relationship  of  an  employee,  subcontractor 
employee,  or  consultant  that  may  impair  objectivity  in  performing  contract 
work.  NNSA  officials  stated  that  it  plans  to  share  the  policy  with  the  DOE 
policy  office  for  potential  application  across  the  department. 

Currently,  DHS  and  HHS  policies  do  not  specifically  prescribe  areas  that 
contractors  must  include  to  address  employees  personal  conflicts. 
However,  DHS  officials  stated  that  they  provided  guidance  to  the  two 
contractors  that  operate  DHS’s  FFRDCs  to  implement  requirements  to 
address  some  of  their  employees’  personal  conflicts  with  DHS’s  interests. 
In  addition,  both  DHS  and  HHS  FFRDC  contractors  provide  that  their  staff 
avoid  or  disclose  financial  interests  or  outside  activities  that  may  conflict 
with  the  interests  of  the  company.  For  example,  the  contractor  operating 
the  FFRDC  for  HHS  requires  about  20  percent  of  its  employees  to  report 
activities  that  may  constitute  a  conflict  with  the  company’s  interests,  but 
allows  the  bulk  of  its  staff  to  self-determine  when  they  need  to  report. 

In  May  2008,  we  reported  that  officials  from  the  Office  of  Government 
Ethics  expressed  concerns  that  current  federal  requirements  and  policies 
are  inadequate  to  prevent  certain  kinds  of  ethical  violations  on  the  part  of 
contractor  employees,  particularly  with  regard  to  financial  conflicts  of 
interest,  impaired  impartiality,  and  misuse  of  information  and  authority. 
The  acting  director  identified  particular  concerns  with  such  conflicts  of 


“FAR  17.601  states:  “Management  and  operating  contract”  means  an  agreement  under 
which  the  government  contracts  for  the  operation,  maintenance,  or  support,  on  its  behalf, 
of  a  government-owned  or  -controlled  research,  development,  special  production,  or 
testing  establishment  wholly  or  principally  devoted  to  one  or  more  major  programs  of  the 
contracting  federal  agency. 

23Department  of  Energy  Acquisition  Regulation  970.0371,  Conduct  of  employees  of  DOE 
management  and  operating  contractors. 
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interest  in  the  management  and  operations  of  large  research  facilities  and 
laboratories.  Our  report  noted  that  DOD  ethics  officials  had  generally  the 
same  concerns.  Therefore,  we  recommended  that  DOD  implement 
personal  conflict-of-interest  safeguards — similar  to  those  for  federal 
employees — for  certain  contractor  employees. 24 

Agencies  Vary  in 
FFRDC  Oversight 
Approaches  and  Do 
Not  Regularly  Share 
Best  Practices 

Sponsoring  agencies  take  various  approaches  in  exercising  oversight  of 
their  FFRDCs.  The  agencies  determine  appropriateness  of  work 
conducted  by  their  FFRDCs;  perform  on-going  and  annual  assessments  of 
performance,  costs  and  internal  controls;  and  conduct  comprehensive 
reviews  prior  to  renewing  sponsoring  agreements.  Each  agency  develops 
its  own  processes  in  these  areas,  and  no  formal  interagency  mechanisms 
exist  to  facilitate  the  sharing  of  FFRDC  oversight  best  practices. 

Agencies  Approve 

Research  Plans  and  Work 
Conducted  at  Their 
FFRDCs 

To  ensure  work  remains  within  each  FFRDCs  purpose,  mission,  scope  of 
effort,  and  special  competency,  sponsoring  agencies  develop  and  approve 
annual  research  plans  for  the  FFRDCs  and  review  and  approve  FFRDC 
work  assigned  on  a  project-by-project  basis.  While  the  majority  of  each 
FFRDC’s  work  is  done  for  its  sponsoring  agency,  FFRDCs  may  perform 
work  for  other  institutions,  subject  to  sponsoring  agency  approval.26 

Officials  at  DOD,  DOE,  and  DHS  identified  the  processes  they  use  to 
develop  annual  research  plans  that  describe  each  FFRDC’s  research 
agenda.  For  example,  DHS  designates  an  executive  agent  to  ensure  that  its 
FFRDC  is  used  for  the  agency’s  intended  purposes.26  Each  year  DHS 
develops  a  research  plan  that  is  reviewed  and  approved  by  the  executive 
agent,  including  any  subsequent  changes.  DHS  also  uses  an  Advisory 
Group27  to  ensure  that  its  FFRDCs  produce  work  consistent  with  the 

24GAO-08-169.  This  report  identified  some  examples  of  how  DOD  FFRDC  contractors  that 
were  implementing  the  new  policy. 

25FAR  35.017-3(a);  35.017(a)(2).  An  FFRDC  may  perform  for  other  than  the  sponsoring 
agency  (1)  under  the  Economy  Act,  or  other  applicable  legislation,  when  the  work  is  not 
otherwise  available  from  the  private  sector  or  (2)  under  a  separate  contract  with  the 
nonsponsoring  agency,  when  permitted  by  the  sponsor. 

26The  Homeland  Security  Act  of  2002  included  a  provision  to  establish  the  Homeland 
Security  Institute.  Section  312  of  the  Act  identifies  specific  types  of  duties  or  capabilities 
that  may  be  requested  to  provide  to  DHS  and  the  homeland  security  community. 

“  The  Executive  Agent  designates  membership  and  chairs  the  HSI  Advisory  Group,  and 
designates  replacements  for  HSI  Advisory  Group  members. 
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sponsoring  agreement.  DOD  has  a  similar  mechanism  for  approving  the 
annual  research  plan  for  its  Lincoln  Laboratory  FFRDC.  This  FFRDC  has  a 
Joint  Advisory  Committee  that  annually  reviews  and  approves  the 
proposed  research  plan.  Members  of  this  committee  include 
representatives  from  the  various  DOD  services — e.g.,  Air  Force,  Army,  and 
Navy — who  are  the  users  of  the  laboratory’s  R&D  capabilities.  Of  the  four 
agencies  included  in  our  review,  only  HHS  does  not  create  a  separate 
annual  research  plan  for  its  FFRDC.  Instead,  the  work  at  HHS’  FFRDC  is 
guided  by  the  National  Cancer  Institute’s  overall  mission,  which  is 
described  in  its  annual  budgetary  and  periodic  strategic  planning 
documents. 

In  determining  the  proposed  research  plan,  DOD  must  abide  by 
congressionally  set  workload  caps.  These  caps  were  imposed  in  the  1990’s 
in  response  to  concerns  that  DOD  was  inefficiently  using  its  FFRDCs,  and 
therefore,  each  fiscal  year  Congress  sets  an  annual  limitation  on  the 
Staffyears  of  Technical  Effort  (STE)  that  DOD  FFRDCs  can  use  to  conduct 
work  for  the  agency.  The  STE  limitations  aim  to  ensure  that  (1)  work  is 
appropriate  and  (2)  limited  resources  are  used  for  DOD’s  highest 
priorities.  Congress  also  sets  an  additional  workload  cap  for  DOD’s 
FFRDCs  for  certain  intelligence  programs.28  Once  DOD  receives  from 
Congress  the  annual  total  for  STEs,  then  DOD’s  Office  of  the 
Undersecretary  of  Acquisition,  Technology  and  Logistics  allocates  them 
across  DOD’s  FFRDCs  based  on  priorities  set  forth  in  the  annual  research 
plan  developed  by  each  FFRDC.  DOD  officials  observed  that  while  the 
overall  DOD  budget  has  increased  about  40  percent  since  the  early  1990s, 
the  STE  caps  have  remained  steady,  and  therefore,  DOD  must  turn  aside 
or  defer  some  FFRDC-appropriate  work  to  subsequent  years.  Although  the 
majority  of  work  that  DOD’s  FFRDCs  conduct  is  subject  to  these 
limitations,  the  work  that  DOD  FFRDCs  conduct  for  non-DOD  entities  is 
not  subject  to  these  caps. 

Each  sponsoring  agency  also  reviews  and  approves  tasks  for  individual 
FFRDC  projects  to  make  sure  that  those  tasks  (1)  are  consistent  with  the 
core  statement  of  the  FFRDC  and  (2)  would  not  constitute  a  “personal 


28The  National  Intelligence  Program  and  the  Military  Intelligence  Program. 
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service”29  or  inherently  governmental  function.30  Listed  below  are  examples 
of  procedures  used  by  agencies  included  in  our  review  to  approve  tasks 
for  individual  projects: 

•  DOD  sponsors  generally  incorporate  in  their  sponsoring  agreement 
guidelines  for  performance  of  work  by  the  FFRDC.  The  work  is  screened 
at  various  levels  for  appropriateness,  beginning  with  FFRDC  clients  who 
request  the  work,  then  program  and  contract  managers,  and  then  it  is 
reviewed  and  approved  as  well  by  the  primary  sponsor.  In  some  cases, 
projects  are  entered  into  a  computer-based  tool,  which  the  Air  Force  has 
developed  to  determine  and  develop  its  overall  requirements  for  that  year. 
The  tool  is  intended  to  assist  the  Air  Force  in  prioritizing  requests  for  its 
FFRDC  and  in  ensuring  that  work  requested  is  in  accordance  with 
guidelines  and  that  potential  alternative  sources  have  been  considered. 

•  DOE  FFRDCs  must  document  all  DOE-funded  projects  using  work 
authorizations31  to  help  ensure  that  the  projects  are  consistent  with  DOE’s 
budget  execution  and  program  evaluation  requirements.32  In  addition,  DOE 
uses  an  independent  scientific  peer-review  approach — including  faculty 
members  and  executives  from  other  laboratories — at  several  of  its  FFRDC 


29As  defined  in  the  FAR  37. 104,  a  personal  services  contract  is  characterized  by  the 
employer-employee  relationship  it  creates  between  the  government  and  the  contractor’s 
personnel.  The  government  is  normally  required  to  obtain  its  employees  by  direct  hire 
under  competitive  appointment  or  other  procedures  required  by  the  civil  service  laws. 
Obtaining  personal  services  by  contract,  rather  than  by  direct  hire,  circumvents  those  laws 
unless  Congress  has  specifically  authorized  acquisition  of  the  services  by  contract. 
Agencies  shall  not  award  personal  services  contracts  unless  specifically  authorized  by 
statute  ( e.g .,  5  U.S.C.  3109)  to  do  so. 

30FAR  Part  2  definition  of  “inherently  governmental  functions”:  An  inherently  governmental 
function  is  a  function  that  is  so  intimately  related  to  the  public  interest  as  to  mandate 
performance  by  government  employees.  These  functions  include  those  activities  that 
require  either  the  exercise  of  discretion  in  applying  Government  authority  or  the  making  of 
value  judgments  in  making  decisions  for  the  government.  Governmental  functions  normally 
fall  into  two  categories:  (1)  the  act  of  governing,  i.e.,  the  discretionary  exercise  of 
government  authority,  and  (2)  monetary  transactions  and  entitlements. 

31The  decision  to  accept  such  work  is  to  be  in  accordance  with  DOE’s  Work  Authorization 
Order  4 12.1  A. 

32DOE  field  organizations  (contracting  officers)  must  receive  a  work  authorization  signed 
by  the  appropriate  primary  DOE  Organization — organizations  that  direct  work  to  be 
performed  by  site  and  facility  management  contractors  and  other  contractors  determined 
by  the  procurement  executive.  Primary  DOE  Organizations,  including  National  Nuclear 
Security  Administration  (NNSA),  must  review  and  approve  the  work  as  acceptable  for  the 
contractor  before  obligating  funds  for  the  contract. 
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laboratories  to  ensure  the  work  performed  is  appropriate  for  the  FFRDC 
and  scientifically  sound.  In  some  cases,  DOE’s  Office  of  Science  holds 
scientific  merit  competitions  between  national  laboratories  (including 
FFRDCs),  universities,  and  other  research  organizations  for  some  R&D 
funding  for  specific  projects. 

•  HHS  uses  an  automated  “yellow  task”  system  to  determine  if  work  is 
appropriate  for  its  FFRDC,  and  several  officials  must  approve  requests  for 
work,  including  the  government  contracting  officer  and  overseeing  project 
officer  for  the  FFRDC,  with  reference  to  a  set  of  criteria.  This  agency 
requires  a  concept  review  by  advisory  boards  for  the  various  HHS 
institutes  to  ensure  the  concept  is  appropriate  for  the  FFRDC  and  meets 
its  mission  or  special  competency. 

•  DHS  requires  certain  officials  at  its  sponsoring  office  to  conduct  a 
suitability  review  using  established  procedures  for  reviewing  and 
approving  DHS-sponsored  tasks.  This  review  is  required  under  DHS’s 
Management  Directive  for  FFRDCs. 


FFRDCs  are  required  to  have  their  sponsors  review  and  approve  any  work 
they  conduct  for  others,  and  the  four  agencies  included  in  our  review  have 
policies  and  procedures  to  do  so.  FFRDCs  may  conduct  work  for  others 
when  required  capabilities  are  not  otherwise  available  from  the  private 
sector.  This  work  for  others  can  be  done  for  federal  agencies,  private 
sector  companies,33  and  local  and  state  governments.  The  sponsoring 
agency  of  an  FFRDC  offers  the  work  for  others,  with  full  costs  charged  to 
the  requesting  entity,  to  provide  research  and  technical  assistance  to  solve 
problems.  At  laboratory  FFRDCs,  work  for  others  can  include  creating 
working  models  or  prototypes.  All  work  placed  with  the  FFRDC  must  be 
within  the  purpose,  mission,  general  scope  of  effort,  or  special 
competency  of  the  FFRDC.34 


33DOD  and  DHS  officials  said  their  FFRDCs  do  not  do  “work  for  others”  for  private  sector 
companies,  and  DOE  officials  said  their  FFRDCs  generally  conduct  work  only  for  federal 
agencies. 

34FAR  17.504(e). 
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Work  for  others  is  considered  a  technology  transfer35  mechanism,  which 
helps  in  sharing  knowledge  and  skills  between  the  government  and  the 
private  sector.  Under  work  for  others,  according  to  DOD  officials  and 
federal  regulation,  the  title  to  intellectual  property  generally  belongs  to  the 
FFRDC  conducting  the  work,  and  the  government  may  obtain  a 
nonexclusive,  royalty-free  license  to  such  intellectual  property  or  may 
choose  to  obtain  the  exclusive  rights.36  As  required  by  FAR,  sponsoring 
agreements  or  sponsoring  agencies  we  reviewed  identified  the  extent  to 
which  their  FFRDCs  may  perform  work  for  other  than  the  sponsors  (other 
federal  agencies,  state  or  local  government,  nonprofit  or  profit 
organizations,  etc.)  and  the  procedures  that  must  be  followed  by  the 
sponsoring  agency  and  the  FFRDC.37  In  addition,  according  to  agency 
officials  FFRDCs  have  a  responsibility  to  steer  inquiries  about  potential 
research  for  other  entities  to  their  primary  sponsor’s  attention  for 
approval.  Agency  officials  stated  that  they  work  with  their  FFRDCs  when 
such  situations  arise. 

DOE’s  Office  of  Science  established  a  “Work  for  Others  Program”  for  all  of 
its  FFRDC  laboratories.  Under  this  program,  the  contractor  of  the  FFRDC 
must  draft,  implement,  and  maintain  formal  policies,  practices,  and 
procedures,  which  must  be  submitted  to  the  contracting  officer  for  review 
and  approval.38  In  addition,  DOE  may  conduct  periodic  appraisals  of  the 
contractor’s  compliance  with  its  Work  for  Others  Program  policies, 
practices,  and  procedures.39  For  DOE’s  National  Nuclear  Security 
Administration  (NNSA),  officials  reported  that  the  work  for  others  process 
at  the  Sandia  National  Laboratories  requires  DOE  approval  before  the 
Sandia  Corporation  develops  the  proposed  statement  of  work,  which  is 
then  sent  to  DOE’s  site  office  for  review  and  approval. 


35Technology  transfer  can  mean  many  things — technical  assistance  to  solve  a  specific 
problem;  use  of  unique  facilities;  access  to  patents  and  software;  exchange  of  personnel; 
and  cooperative  research.  Technology  transfer  mechanisms  can  include  Cooperative 
Agreements,  Cooperative  Research  and  Development  Agreements  (CRADAs),  Cost-Shared 
Contracts/Subcontracts,  Licensing,  and  Work  for  Others. 

36See  generally  FAR  subparts  27.3  and  27.4. 

37FAR  35.017(a)(2);  37.017-3(b). 

38See  DOE  Order  481.1B,  att.  1. 

39DOE  officials  said  that  DOE  programs  and  work  for  others  customers  both  are  charged  an 
indirect  cost  rate  that  includes  a  Laboratory  Directed  Research  Development  component. 
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For  DHS,  each  FFRDC  includes  the  work  for  others  policy  in  its 
management  plan.  For  example,  one  management  plan  states  that  the 
FFRDC  may  perform  work  for  others  and  that  such  work  is  subject  to 
review  by  the  sponsoring  agency  for  compliance  with  criteria  mutually 
agreed  upon  by  the  sponsor  and  the  FFRDC  contractor.  The  DHS  FFRDC 
laboratory  director  said  he  routinely  approves  any  work-for-others 
requests  but  gives  first  priority  to  the  DHS-sponsored  work.  The  sponsor 
for  this  FFRDC  also  periodically  assesses  whether  its  work  for  others 
impairs  its  ability  to  perform  work  for  its  sponsor. 

HHS  and  DOD  also  have  work-for-others  programs  for  the  FFRDCs  they 
sponsor.  For  example,  at  HHS’s  FFRDC  the  program  is  conducted  under  a 
bilateral  contract  between  the  entity  that  is  requesting  the  work  and  the 
FFRDC  to  perform  a  defined  scope  of  work  for  a  defined  cost.  This  agency 
developed  a  standard  Work  for  Others  Agreement  for  its  FFRDC,  the  terms 
and  conditions  of  which  help  ensure  that  the  FFRDC  complies  with 
applicable  laws,  regulations,  policies,  and  directives  specified  in  its 
contract  with  the  HHS. 

Some  agency  sponsors  report  that  work  for  others  at  their  FFRDCs  has 
grown  in  the  past  few  years.  For  example,  DOE  officials  said  work  for 
others  at  the  Sandia  National  Laboratories  related  to  nanotechnologies 
and  cognitive  sciences  has  grown  in  the  last  3  years.  As  shown  in  table  1, 
the  amount  of  work  for  others  by  FFRDCs  since  fiscal  year  2001  has 
increased  for  many  of  the  FFRDCs  included  in  our  review. 
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Table  1:  Funding  for  FFRDC 

“Work  for  Others”  (Fiscal  Year  2001  to  2005) 

Dollars  in  thousands 

Sponsoring  agency  and 
name  of  FFRDC 

FY  2001 

FY  2002 

FY  2003 

FY  2004 

FY  2005“ 

DOE,  Office  of  Science 

Ernest  Orlando  Lawrence 
Berkeley  National 

Laboratory 

$69,879 

$67,053 

$59,911 

$76,360 

$71,879 

DOE,  National  Nuclear 
Security  Administration 

$114,390 

$143,798 

$130,614 

$171,492 

$270,438 

Sandia  National 

Laboratories 

HHS,  National  Cancer 
Institute 

$30,810 

$52,122 

$119,490 

$144,184 

$105,559 

National  Cancer  Institute  at 
Frederick  (NCI-F) 

DOD,  Office  of  the 

Secretary  of  Defense 

$47,300 

$69,800 

$98,800 

$134,000 

$163,700 

C3I  [Command,  Control, 
Communications,  and 
Intelligence]  Center 

DOD,  Office  of  the 

Secretary  of  Defense 

Institute  for  Defense 

Analyses  (IDA)  Studies  and 
Analyses  Center 

$2,602 

$5,712 

$7,825 

$22,504" 

$6,547 

DOD,  Department  of  the  Air 
Force 

$53,368 

$51,604 

$43,885 

$65,161 

$64,408 

MIT  Lincoln  Laboratory 

DHS,  Office  of  Science  and 
Technology 

$0 

$0 

Homeland  Security  Institute' 

DHS,  Office  of  Science  and 
Technology 

National  Biodefense 

Analysis  and 
Countermeasures  Center 
(NBACC)d 

Source:  GAO  Analysis  of  data  provide  by  the  National  Science  Foundation  (NSF)  and  by  listed  agencies  (where  provided). 


“Most  recently  available  complete  data. 

"According  to  DOD,  the  fiscal  year  2004  data  for  IDA  includes  $14.3  million  from  DHS  for  work 
regarding  implementation  of  the  Support  Anti-terrorism  by  Fostering  Effective  Technologies  Act  of 
2002  (the  SAFETY  Act). 

“Homeland  Security  Institute  (HSI),  was  funded  as  a  new  FFRDC  in  fiscal  year  2004. 
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"National  Biodefense  Analysis  and  Countermeasures  Center  (NBACC),  was  funded  as  a  new  FFRDC 
in  fiscal  year  2007. 

While  funding  for  work  for  others  has  increased,  some  agencies  in  our 
review  reported  limiting  the  amount  of  work  for  others  their  FFRDCs 
conduct.  For  example,  DOE’s  Office  of  Science  annually  approves  overall 
work-for-others  funding  levels  at  its  laboratories  based  on  a  request  from 
the  laboratory  and  recommendation  from  the  responsible  site  office.  Any 
work-for-others  program  that  is  above  20  percent  of  the  laboratory’s 
operating  budget,  or  any  request  that  represents  a  significant  change  from 
previous  year’s  work-for-others  program  will  be  reviewed  in  depth  before 
the  approval  is  provided.  Similarly,  DOE  officials  limit  commitments  to 
conduct  work  for  others  at  the  National  Renewable  Energy  Laboratory’s  to 
about  10  percent  of  the  laboratory’s  total  workload. 


Agencies  Assess  FFRDCs’  In  addition  to  ensuring  work  is  appropriate  for  their  FFRDCs,  the  four 
Performance,  Costs,  and  sponsoring  agencies  in  our  case  study  regularly  review  the  contractors’ 
Internal  Controls  performance  in  operating  the  FFRDCs,  including  reviewing  and  approving 

costs  incurred  in  operations  and  internal  control  mechanisms.  Agency 
performance  evaluations  for  FFRDC  contractors  vary,  particularly 
between  those  that  incorporate  performance  elements  into  their  contracts 
and  those  that  do  not.  Furthermore,  contracting  officers  at  each  agency 
regularly  review  costs  to  ensure  that  they  are  appropriate,  in  some  cases 
relying  on  audits  of  costs  and  internal  controls  to  highlight  any  potential 
issues. 


Agencies  Review  Performance  All  four  agencies  conduct  at  least  annual  reviews  of  the  performance  of 
of  FFRDC  and  Operating  their  FFRDCs  and  contractors.  At  three  agencies,  the  outcomes  of  these 

Contractor  reviews  provide  the  basis  for  contractors  to  earn  performance-based 

incentives  or  awards.  Specifically,  DOE,  HHS,  and  DHS  provide  for  award 
fees40  to  motivate  contractors  toward  excellence  in  high  performance,  and 
contractors  operating  FFRDCs  for  DOE  and  DHS  may  earn  additional 
contract  extensions  by  exceeding  performance  expectations. 


40In  December  2005  and  January  2007,  we  issued  reports  on  the  use  of  award  and  incentive 
fees  at  the  Department  of  Defense  and  the  National  Aeronautics  and  Space  Administration, 
respectively.  GAO,  Defense  Acquisitions:  DOD  Has  Paid  Billions  in  Award  and  Incentive 
Fees  Regardless  of  Acquisition  Outcomes,  GAO-06-66  (Washington,  D.C.:  Dec.  19,  2005) 
and  NASA  Procurement:  Use  of  Award  Fees  for  Achieving  Program  Outcomes  Should  Be 
Improved,  GAO-07-58  (Washington,  D.C.:  Jan.  17,  2007). 
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DOE  uses  a  performance-based  contracting  approach  with  its  FFRDCs, 
which  includes  several  mechanisms  to  assess  performance.  First,  DOE 
requires  contractors  to  conduct  annual  self-assessments  of  their 
management  and  operational  performance.  Also,  contracting  officers 
conduct  annual  assessments  of  the  performance  of  the  FFRDC  contractor, 
relying  in  part  on  user  satisfaction  surveys.  All  of  this  input  contributes  to 
each  lab’s  annual  assessment  rating.  For  example,  Sandia  National 
Laboratories,  operated  by  Sandia  Corporation  (a  subsidiary  of  Lockheed 
Martin)  received  an  overall  rating  of  “outstanding”  for  fiscal  year  2007  and 
was  awarded  91  percent  of  its  available  award  fee  ($7.6  million  of  a 
possible  total  fee  of  $8.4  million).  DOE  noted  that  Sandia  National 
Laboratories’  scientific  and  engineering  support  of  U.S.  national  security 
was  an  exceptional  performance  area.  DOE  publishes  such  “report  cards” 
for  its  laboratories  on  the  internet.  DOE  includes  detailed  performance 
requirements  in  each  contract  in  a  Performance  Evaluation  and 
Measurement  Plan  that  is  organized  by  goals,  objectives,  measures,  and 
targets.  The  DOE  Office  of  Science  mandates  that  each  of  its  ten  FFRDC 
laboratories  establish  the  same  eight  goals41  in  each  FFRDC’s  contractual 
plan.  For  example,  the  Ernest  Orlando  Lawrence  Berkeley  National 
Laboratory,  operated  by  the  University  of  California,  received  high  ratings 
in  providing  efficient  and  effective  mission  accomplishment  and  science 
and  technology  program  management.  These  ratings  resulted  in  an  award 
of  94  percent  or  $4.2  million  of  the  total  available  fee  of  $4.5  million. 

HHS,  which  also  uses  performance-based  contracting,  has  identified 
certain  designated  government  personnel  to  be  responsible  for  evaluation 
of  the  FFRDC  contractor.  This  review  process  includes  different  levels  of 
reviews,  from  coordinators  who  review  performance  evaluations  to  an 
FFRDC  Performance  Evaluation  Board,  which  is  responsible  for  assessing 
the  contractor’s  overall  performance.  The  board  rates  each  area  of 
evaluation  based  on  an  established  Performance  Rating  System  to 
determine  the  amount  of  the  contractor’s  award  fee.  In  fiscal  year  2007, 


41The  performance-based  approach  focuses  the  evaluation  of  the  contractor’s  performance 
against  eight  goals:  (1)  provide  for  efficient  and  effective  mission  accomplishment;  (2) 
Provide  for  efficient  and  effective  design,  fabrication,  construction  and  operations  of 
research  facilities;  (3)  provide  effective  and  efficient  science  and  technology  program 
management;  (4)  provide  competent  leadership  and  stewardship;  (5)  sustain  and  enhance 
effectiveness  of  integrated  safety,  health,  and  environmental  protection;  (6)  deliver 
efficient,  effective,  and  responsive  business  systems  and  resources;  (7)  sustain  excellence 
in  operating,  maintaining,  and  renewing  the  facility  and  infrastructure  portfolio  to  meet 
laboratory  needs;  and  (8)  sustain  and  enhance  the  effectiveness  of  integrated  safeguards, 
security,  and  emergency  management  systems. 
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Agencies  Review  Costs  and 
Internal  Controls 


the  National  Cancer  Institute  at  Frederick,  operated  by  Science 
Applications  International  Corporation-Frederick  (a  subsidiary  of  Science 
Applications  International  Corporation),  received  92  percent  of  its 
available  award  fee  or  $6.9  million  of  a  possible  $7.4  million. 

Similar  to  the  other  agencies,  DHS  regularly  conducts  performance 
reviews  throughout  the  life  cycle  of  its  FFRDC  contract.  This  includes 
program  reviews  as  described  in  the  sponsoring  agreement,  midyear  status 
reviews,  technical  progress  reports,  monthly  and  quarterly  reports,  and 
annual  stakeholder  surveys  to  ensure  the  FFRDC  is  meeting  customer 
needs.  DHS  also  drafts  a  multiyear  improvement  plan  and  collects 
performance  metrics  as  evidence  of  the  FFRDC’s  performance.  For  fiscal 
year  2007,  Battelle  National  Biodefense  Institute,  operating  the  National 
Biodefense  Analysis  and  Countermeasures  Center,  received  82  percent  of 
its  performance-based  award  fee  amounting  to  $1.4  million.  According  to 
DHS  officials,  Analytic  Services,  Inc.,  which  operates  the  Homeland 
Security  Institute,  received  a  fixed  fee  of  about  2  percent  or  approximately 
$.68  million  for  fiscal  year  2007. 

DOD  conducts  annual  performance  reviews  and  other  internal  reviews, 
such  as  conducting  periodic  program  management  reviews  and  annual 
customer  surveys  to  monitor  the  performance  of  its  FFRDCs  in  meeting 
their  customers’  expectations.  As  part  of  this  review  process,  major  users 
are  asked  to  provide  their  perspectives  on  such  factors  as  the  use  and 
continuing  need  for  the  FFRDC,  and  how  these  users  distinguish  work  to 
be  performed  by  the  FFRDC  from  work  to  be  performed  by  others. 
According  to  DOD,  these  performance  evaluations  provide  essential  input 
to  help  it  assess  the  effectiveness  and  efficiency  of  the  FFRDC’s 
operations.  Typically  the  performance  reviews  obtain  ratings  from  FFRDC 
users  and  sponsors  on  a  variety  of  factors  including  the  quality  and  value 
of  the  work  conducted  by  the  FFRDCs,  as  well  as  its  ability  to  meet 
technical  needs,  provide  timely  and  responsive  service,  and  manage 
costs.42 

Federal  regulations,  policies,  and  contracts  establish  various  cost, 
accounting,  and  auditing  controls  that  agencies  use  to  assess  the  adequacy 
of  FFRDC  management  in  ensuring  cost-effective  operations  and  ensure 


42DOD  generally  does  not  provide  award  or  incentive  fees  to  its  FFRDCs,  which  for  our 
case  study  included  the  Institute  for  Defense  Analyses,  operating  the  Studies  and  Analysis 
Center;  MITRE,  operating  the  C3I  systems  engineering  and  integration  center;  and 
Massachusetts  Institute  of  Technology  operating  the  Lincoln  Laboratory. 
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that  costs  of  services  being  provided  to  the  government  are  reasonable.43 
Sponsors  of  the  FFRDCs  we  reviewed  employ  a  variety  of  financial  and 
auditing  oversight  mechanisms  to  review  contractors’  management 
controls,  including  incurred  cost  audits,  general  financial  and  operational 
audits,  annual  organizational  audits,  and  audited  financial  statements. 
These  mechanisms  differ,  depending  on  the  agencies  involved  and  the  type 
of  organization  operating  the  FFRDCs.44 

Under  cost-reimbursement  contracts,  the  costs  incurred  are  subject  to 
cost  principles  applicable  to  the  type  of  entity  operating  the  FFRDC.45  Most 
FFRDC  contracts  we  examined  include  a  standard  clause  on  allowable 
costs  that  limits  contract  costs  to  amounts  that  are  reasonable  and  in 
compliance  with  applicable  provisions  of  the  FAR.46  Under  the  FAR, 
contracting  officers  are  responsible  for  authorizing  cost-reimbursement 
payments  and  may  request  audits  at  their  discretion  before  a  payment  is 
made.  In  addition,  when  an  allowable  cost  clause  is  included  in  a  contract, 
the  FAR  requires  that  an  indirect  cost  rate  proposal  be  submitted  annually 
for  audit.47  At  DOD,  the  Defense  Contract  Audit  Agency  (DCAA)  generally 
performs  both  annual  incurred  cost  audits  and  close-out  audits  for 
completed  contracts  and  task  orders  at  the  end  of  an  FFRDC’s  5-year 


43FAR  35.017-2(e)  requires  that  the  FFRDC  sponsor  in  establishing  an  FFRDC  ensure  that 
controls  are  established  to  ensure  that  the  costs  of  the  services  being  provided  to  the 
government  are  reasonable.  FAR  35.017-4  requires  that  the  review  conducted  prior  to 
extending  the  FFRDC  contract  or  agreement  include  an  assessment  of  the  adequacy  of  the 
FFRDC  management  in  ensuring  a  cost-effective  operation. 

44Since  this  review  of  FFRDCs  focuses  only  on  broad  processes  employed  in  the 
management  and  operation  of  FFRDCs,  we  reviewed  practices  and  procedures  that 
agencies  use  but  did  not  attempt  to  determine  either  the  most  effective  agency  cost, 
accounting,  or  auditing  controls,  or  the  effectiveness  of  or  deficiencies  in  specific  agencies’ 
cost  or  internal  controls  at  the  agencies  and  FFRDCs  we  reviewed. 

'  FAR  Part  31  specifies  different  cost  principles  on  the  allowability  of  various  kinds  of  costs 
for  different  types  of  contractors:  FAR  31.2  specifies  allowable  cost  principles  for 
commercial  organizations;  FAR  31.3,  which  incorporates  OMB  Circular  No.  A-21,  applies  to 
educational  institutions;  and  FAR  31.7,  which  incorporates  OMB  Circular  No.  A-122,  applies 
to  nonprofit  organizations.  FAR  31.201-2(a)  governing  contracts  with  commercial  firms 
states,  for  example,  that  the  factors  to  be  considered  in  determining  whether  a  cost  is 
allowable  include:  (1)  reasonableness;  (2)  allocability;  (3)  standards  promulgated  by  the 
Cost  Accounting  Standards  Board,  if  applicable;  otherwise  GAAP;  (4)  the  terms  of  the 
contract;  and  (5)  any  limitations  set  fort  in  subpart  31.2. 

46FAR  52.216-7  “Allowable  Cost  and  Payment”  requires  the  government  to  pay  a  contractor, 
if  requested,  as  work  progresses,  in  amounts  determined  to  be  allowable  by  the  contracting 
officer  in  accordance  with  the  applicable  cost  principles  identified  above. 

47FAR  42.705-l(b)(4);  42.705-2(b)(2). 
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contract  term.  The  audit  results  are  included  in  the  comprehensive  review 
of  DOD’s  continued  need  for  its  FFRDCs.  DCAA  also  performs  these  types 
of  audits  for  DHS’s  FFRDCs.  At  DOE,  the  Office  of  the  Inspector  General 
is  responsible  for  incurred  cost  audits  for  major  facilities  contractors.  At 
HHS,  officials  stated  that  while  the  contracting  officer  for  its  FFRDC 
regularly  reviews  the  incurred  costs,  no  audits  of  these  costs  have  been 
performed. 

Agencies  and  FFRDC  contractors  also  conduct  financial  and  operational 
audits48  in  addition  to  incurred  cost  audits.  DOE  relies  primarily  upon 
FFRDC  contractors’  annual  internal  audits49  rather  than  on  third-party 
monitoring  through  external  audits.  These  internal  audits  are  designed  to 
implement  DOE’s  Cooperative  Audit  Strategy — a  program  that  partners 
DOE’s  Inspector  General  with  contractors’  internal  audit  groups  to 
maximize  the  overall  audit  coverage  of  M&O  contractors’  operations  and 
to  fulfill  the  Inspector  General’s  responsibility  for  auditing  the  costs 
incurred  by  major  facilities  contractors.50  This  cooperative  audit  strategy 
permits  the  Inspector  General  to  make  use  of  the  work  of  contractors’ 
internal  audit  organizations  to  perform  operational  and  financial  audits, 
including  incurred  cost  audits,  and  to  assess  the  adequacy  of  contractors’ 
management  control  systems.  DHS  and  DOD  generally  rely  on  audits 
performed  by  those  agencies,  a  designated  audit  agency,  or  an  accounting 
firm,  though  their  FFRDC  contractors  usually  perform  some  degree  of 
internal  audit  or  review  function  as  part  of  their  overall  management 
activity. 

In  addition,  all  nonprofits  and  educational  institutions  that  annually 
expend  more  than  $500,000  in  federal  awards — including  those  that 


48Financial  audits  address  issues  such  as  compliance  with  cost-accounting  standards, 
compensation  and  labor  cost  reviews,  and  advance  agreements  on  forward-pricing  factors 
such  as  indirect  cost  rates  and  labor  hour  rates  used  in  repetitive-pricing  formulas,  among 
many  others.  Operational  audits  include  audits  of  accounting  and  information  technology 
systems’  internal  controls;  and  reviews  of  integrated  business  processes,  program 
administration,  financial  and  business  operations,  and  project  execution. 

49DOE  generally  requires  M&O  contractors,  including  the  contractors  for  Sandia  National 
Laboratory  and  the  Ernest  Orlando  Lawrence  Berkeley  National  Laboratory,  to  perform 
annual  internal  audits,  under  Department  of  Energy  Acquisition  Regulation  §  970.5232-3 
and  standard  contract  clause  1.103  (Accounts,  Record,  and  Inspection-June  2007). 

50The  Cooperative  Audit  Strategy  was  first  developed  and  implemented  in  1992  and 
implemented  in  2007  with  respect  to  all  M&O  contractors,  including  FFRDCs. 
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operate  FFRDCs — are  subject  to  the  Single  Audit  Act51  which  requires 
annual  audits  of:  (1)  financial  statements,  (2)  internal  controls,  and  (3) 
compliance  with  laws  and  regulations.  We  have  previously  reported  these 
audits  constitute  a  key  accountability  mechanism  for  federal  awards  and 
generally  are  performed  by  independent  auditors. 52  At  DOD,  for  example, 
DCAA  participates  in  single  audits  normally  on  a  “coordinated  basis” — at 
the  election  of  the  organization  being  audited — with  the  audited 
organization’s  independent  public  accountant.  The  financial  statements, 
schedules,  corrective  action  plan,  and  audit  reports  make  up  the  single 
audit  package,  which  the  audited  organization  is  responsible  for 
submitting  to  a  federal  clearing  house  designated  by  OMB  to  receive, 
distribute,  and  retain.  DOD’s  Office  of  Inspector  General,  for  example,  as  a 
responsible  federal  agency,  receives  all  single  audit  submissions  for 
nonprofits  and  educational  institutions  that  operate  DOD’s  FFRDCs.  These 
audit  results  are  employed  by  DOD  as  partial  evidence  of  its  FFRDCs’  cost- 
effectiveness  and  incorporated  in  the  5-year  comprehensive  reviews. 

These  annual  single  audits  for  nonprofit  and  educational  FFRDC 
contractors  are  a  useful  adjunct  to  other  cost,  accounting,  and  auditing 
controls  discussed  previously,  designed  to  help  determine  contractor 
effectiveness,  efficiency,  and  accountability  in  the  management  and 
operation  of  their  FFRDCs. 

Private  contractors  that  publicly  trade  their  securities  on  the  exchanges — 
including  those  that  operate  FFRDCs53 — are  registered  with  the  Securities 


5131  U.S.C.  7501-7507.  Office  of  Management  and  Budget  (OMB)  Circular  A-133,  “Audits  of 
States,  Local  Governments,  and  Non-profit  Organizations,”  implements  the  Single  Audit  Act 
and  is  applicable  to  all  FFRDCs  operated  by  an  educational  institution  or  non-profit 
organization,  but  not  to  those  operated  by  commercial  contractors.  Audits  are  commonly 
referred  to  as  “single  audits”  and  are  performed  in  accordance  with  Generally  Accepted 
Government  Auditing  Standards  (GAGAS).  The  Single  Audit  Act  is  designed  to  help  federal 
agencies  meet  the  need  for  oversight  and  uniformly  structured  audits  of  non-profit 
recipients  that  expend  annually  a  total  of  $500,000  or  more  in  federal  awards.  Rather  than 
being  a  detailed  review  of  individual  programs,  the  single  audit  is  an  organization-wide 
financial  statement  audit  that  includes  the  audit  of  the  Schedule  of  Federal  Awards,  and 
also  focuses  on  internal  control  and  the  recipient’s  compliance  with  laws  and  regulations 
governing  the  receipt  of  federal  financial  awards.  The  federal  agency  that  makes  an  award 
is  responsible  for  overseeing  whether  the  single  audits  are  completed  in  a  timely  manner, 
while  the  award  recipient  is  responsible  for  ensuring  that  a  single  audit  is  performed  and 
submitted  when  due  and  for  following  up  and  taking  corrective  action  on  any  audit 
findings. 

52GAO,  Single  Audit  Quality:  Actions  Needed  to  Address  Persistent  Audit  Quality 
Problems,  GAO-08-213T  (Washington,  D.C.:  Oct.  25,  2007). 

53 According  to  the  NSF  Master  List  of  FFRDCs,  five  FFRDCs  (four  at  DOE  and  one  at  HHS) 
are  operated  by  private  companies. 
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and  Exchange  Commission  (SEC)  and  are  required  to  file  audited  financial 
statements  with  the  SEC.  These  audited  statements  must  be  prepared  in 
conformity  with  generally  accepted  accounting  principles  (GAAP)  and 
securities  laws  and  regulations,  including  Sarbanes-Oxley,  that  address 
governance,  auditing,  and  financial  reporting.54  These  financial  statements 
are  designed  to  disclose  information  for  the  benefit  of  the  investing  public, 
not  to  meet  government  agencies’  information  needs.  Accordingly,  SAIC 
and  Lockheed — private  contractors  that  manage  National  Cancer  Institute 
at  Frederick  and  Sandia  National  Laboratories  respectively — prepare 
audited  financial  statements  for  their  corporate  entities,  but  do  not 
separately  report  information  on  their  individual  FFRDCs’  operations. 

Finally,  even  though  financial  statements  are  not  required  by  university 
and  nonprofit  sponsored  FFRDCs,  some  of  the  FFRDCs  in  agencies  we 
reviewed  have  audited  financial  statements  prepared  solely  for  their  own 
operations.  DOD’s  Aerospace  and  DHS’s  HSI  and  NBACC  are  examples. 
Most  others’  financial  operations,  however,  are  included  in  the  audited 
financial  statements  of  their  parent  organizations  or  operating  contractor. 
Some,  like  MITRE,  which  manages  not  only  DOD’s  C3I FFRDC  but  also 
two  others  (one  for  the  Federal  Aviation  Administration  and  one  for  the 
Internal  Revenue  Service),  provides  supplemental  schedules,  with  balance 
sheets,  revenues  and  expenses,  and  sources  and  uses  of  funds  for  all  three 
FFRDCs.55  Others,  like  the  Institute  for  Defense  Analyses,  which  also 
operates  two  other  FFRDCs  in  addition  to  the  Studies  and  Analyses  Center 
for  DOD,  provide  only  a  consolidated  corporate  statement  with  no 
information  on  specific  FFRDCs. 


Agencies  Periodically  The  FAR  requires  that  a  comprehensive  review  be  undertaken  prior  to 

Rejustify  Their  extending  a  sponsoring  agreement  for  an  FFRDC.  We  found  that  the  four 

Sponsorship  of  FFRDCs  agencies  in  our  case  study  were  conducting  and  documenting  these 

reviews,  but  noted  that  implementation  of  this  requirement  by  each  agency 


54The  Securities  Exchange  Act  of  1934  as  amended,  including  implementing  regulations, 
requires  publicly  traded  companies  to  make  periodic  filings  with  the  Securities  and 
Exchange  Commission  that  disclose  their  financial  status  and  changes  in  financial 
condition.  These  publicly  traded  companies  are  also  subject  to  the  Sarbanes-Oxley  Act  of 
2002  requirements  that  include  provisions  for  governance,  auditing,  and  financial  reporting. 

55The  supplemental  information  is  prepared  by  MITRE’s  independent  auditors  and,  while 
not  formally  audited,  was  subjected  to  the  same  auditing  procedures  as  applied  to  the 
corporation’s  financial  statements,  and  according  to  the  auditor  are  “fairly  stated  in  all 
material  respects  in  relation  to  the  financial  statements  taken  as  a  whole.” 
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is  based  on  its  own  distinct  management  policies,  procedures,  and 
practices. 

During  the  reviews  prior  to  agreement  renewal,  sponsoring  agencies 
should  include  the  following  five  areas  identified  by  the  FAR 

•  examination  of  the  continued  need  for  FFRDC  to  address  its  sponsor’s 
technical  needs  and  mission  requirements; 

•  consideration  of  alternative  sources,  if  any,  to  meet  those  needs; 

•  assessment  of  the  FFRDC’s  efficiency  and  effectiveness  in  meeting  the 
sponsor’s  needs,  including  objectivity,  independence,  quick  response 
capability,  currency  in  its  field(s)  of  expertise,  and  familiarity  with  the 
sponsor; 

•  assessment  of  the  adequacy  of  FFRDC  management  in  ensuring  a  cost- 
effective  operation;  and 

•  determination  that  the  original  reason  for  establishing  the  FFRDC  still 
exists  and  that  the  sponsoring  agreement  is  in  compliance  with  FAR 
requirements  for  such  agreements.56 

DOD  sponsoring  offices  begin  conducting  detailed  analyses  for  each  of  the 
five  FAR  review  criteria  approximately  1  to  2  years  in  advance  of  the 
renewal  date.  As  DOD  has  received  criticism  in  the  past  for  its  lack  of 
competition  in  awarding  FFRDC  contracts,  it  now  conducts  detailed  and 
lengthy  comprehensive  reviews  prior  to  renewing  FFRDC  sponsoring 
agreements  and  contracts  with  incumbent  providers.  DOD’s  FFRDC 
Management  Plan  lays  out  procedures  to  help  provide  consistency  and 
thoroughness  in  meeting  FAR  provisions  for  the  comprehensive  review 
process.  DOD  procedures  require,  and  the  comprehensive  reviews  we 
examined  generally  provided,  detailed  examinations  of  the  mission  and 
technical  requirements  for  each  FFRDC  user,  and  explanations  of  why 
capabilities  cannot  be  provided  as  effectively  by  other  alternative  sources. 
For  example,  DOD  convened  a  high  level,  independent  Technical  Review 
Panel  to  review  whether  Lincoln  Laboratory’s  research  programs  were 
within  its  mission  as  well  as  whether  the  research  was  effective,  of  high 
technical  quality,  and  of  critical  importance  to  DOD.  The  panel — 


56FAR  35.017-4(c). 
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composed  of  a  former  Assistant  Secretary  of  the  Air  Force,  a  former 
president  of  another  FFRDC,  former  senior  military  officers,  and  a  high 
level  industry  representative — found  that  no  other  organizations  had  the 
capacity  to  conduct  a  comparable  research  program.  In  addition,  DOD 
sponsors  use  information  from  annual  surveys  of  FFRDC  users  that 
address  such  performance  areas  as  cost  effectiveness  and  technical 
expertise.  Determinations  to  continue  or  terminate  the  FFRDC  agreement 
are  made  by  the  heads  of  sponsoring  DOD  components  (e.g.,  the  Secretary 
of  the  Army  or  Air  Force)  with  review  and  concurrence  by  the  Office  of 
the  Under  Secretary  of  Defense  for  Acquisition,  Technology,  and  Logistics. 

DOE  has  a  documented  comprehensive  review  process  that  explicitly 
requires  DOE  sponsors  to  assess  the  use  and  continued  need  for  the 
FFRDC  before  the  term  of  the  agreement  has  expired.  DOE’s  process 
requires  that  the  review  be  conducted  at  the  same  time  as  the  review 
regarding  the  decision  to  extend  (by  option)  or  compete  its  FFRDC 
operating  contract.  According  to  DOE’s  regulation,57  the  option  period  for 
these  contracts  may  not  exceed  5  years  and  the  total  term  of  the  contract, 
including  any  options  exercised,  may  not  exceed  10  years.  DOE  relies  on 
information  developed  as  part  of  its  annual  performance  review 
assessments  as  well  as  information  developed  through  the  contractor’s 
internal  audit  process  to  make  this  determination.  The  comprehensive 
review  conducted  prior  to  the  most  recent  award  of  the  contract  to 
operate  Sandia  National  Laboratories  concluded  that  the  FFRDC’s  overall 
performance  for  the  preceding  6  years  had  been  outstanding.  The 
Secretary  of  Energy  determined  that  the  criteria  for  establishing  the 
FFRDC  continued  to  be  satisfied  and  that  the  sponsoring  agreement  was 
in  compliance  with  FAR  provisions. 

At  DHS,  we  found  that  its  guidance  and  process  for  the  comprehensive 
review  mirror  many  aspects  of  the  DOD  process.  DHS  has  undertaken  only 
one  such  review  to  date,  which  was  completed  in  May  2008.  As  of  the  time 
we  completed  our  work,  DHS  officials  told  us  that  the  documentation 
supporting  the  agency’s  review  had  not  yet  been  approved  for  release. 

HHS — in  contrast  to  the  structured  review  processes  of  the  other 
agencies — relies  on  the  judgment  of  the  sponsoring  office’s  senior 
management  team,  which  reviews  the  need  for  the  continued  sponsorship 
of  the  FFRDC  and  determines  whether  it  meets  the  FAR  requirements. 


’‘Department  of  Energy  Acquisition  Regulation  §  970.1706-1. 
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Agency  officials  stated  that  this  review  relies  on  a  discussion  of  the 
FFRDC’s  ability  to  meet  the  agency’s  needs  within  the  FAR  criteria,  but 
noted  there  are  no  formal  procedures  laid  out  for  this  process.  The  final 
determination  is  approved  by  the  director  of  the  National  Cancer  Institute 
and  then  the  director  of  the  National  Institutes  of  Health. 


No  Formal  Interagency 
Mechanisms  Exist  for 
Sharing  of  Best  Practices 
for  Overseeing  FFRDCs 

DHS  officials  have  adopted  several  of  DOD’s  and  DOE’s  policies  and 
procedures  for  managing  FFRDCs  to  help  their  newly  created  FFRDCs 
gain  efficiencies.  DHS  mirrored  most  of  DOD’s  FFRDC  Management  Plan, 
and  officials  have  stated  that  the  STE  limitations  for  DOD  could  be  a 
potentially  useful  tool  for  focusing  FFRDCs  on  the  most  strategic  and 
critical  work  for  the  agency.  Also,  DHS  officials  stated  they  have  made  use 
of  DOE’s  experience  in  contracting  for  and  overseeing  the  operation  of  its 
laboratories,  such  as  including  a  DOE  official  in  the  DHS  process  to  select 
a  contractor  to  operate  its  laboratory  FFRDC.  In  addition,  HHS  officials 
said  they  are  incorporating  the  DOE  Blue  Ribbon  Report  recommendation 
to  set  aside  a  portion  of  the  incentive  fee  paid  on  their  FFRDC  contract  to 
reward  scientific  innovations  or  research.  The  idea  for  the  new  contract  is 
to  base  80  percent  of  the  available  award  fee  in  a  performance  period  on 
operations  and  use  the  final  20  percent  to  reward  innovation.  HHS  also 
may  adopt  the  technique  used  by  DOE  of  providing  for  contract  extensions 
on  the  basis  of  demonstrated  exceptional  performance. 

To  take  advantage  of  others’  experiences,  some  FFRDCs  sponsored  by 
particular  agencies  have  formed  informal  groups  to  share  information.  For 
example,  DOD’s  FFRDCs  have  formed  informal  groups  at  the  functional 
level — Chief  Financial  Officers,  Chief  Technology  Officers,  and  General 
Counsels — which  meet  periodically  to  share  information  on  issues  of 
common  concern.  In  addition,  the  security  personnel  from  the  DOD 
FFRDC  contractors  meet  once  a  year  to  discuss  security  and  export 
control  related  issues.  The  contractor  officials  at  Sandia  National 
Laboratories  said  they  share  best  practices  for  operating  DOE’s  laboratory 
FFRDCs  at  forums  such  as  the  National  Laboratory  Improvement  Council. 
This  Council  was  also  mentioned  in  a  DOE  review  of  management  best 


Some  agencies  have  used  the  experiences  of  other  agencies  as  a  model  for 
their  own  oversight  of  their  FFRDCs.  There  is  no  formal  mechanism, 
however,  for  sharing  of  best  practices  and  lessons  learned  among 
sponsoring  agencies. 
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practices  for  the  national  laboratories58  as  one  of  the  few  groups  that 
deliberate  a  broader  and  more  integrated  agenda  among  laboratories. 

Despite  these  instances  of  information  sharing  within  agencies  and  the 
acknowledgment  by  some  officials  of  potential  benefits  in  such  knowledge 
sharing,  no  formal  mechanisms  exist  for  sharing  information  across 
agencies  that  sponsor  and  oversee  FFRDCs.  We  reported  in  2005  that 
federal  agencies  often  carry  out  related  programs  in  a  fragmented, 
uncoordinated  way,  resulting  in  a  patchwork  of  programs  that  can  waste 
scarce  funds,  confuse  and  frustrate  program  customers,  and  limit  the 
overall  effectiveness  of  the  federal  effort.69  The  report  suggested  frequent 
communication  across  agency  boundaries  can  prevent  misunderstandings, 
promote  compatibility  of  standards,  policies,  and  procedures,  and  enhance 
collaboration.  For  example,  the  Federal  Laboratory  Consortium  for 
Technical  Transfer  was  created  to  share  information  across  national 
laboratories.  This  includes  the  FFRDC  laboratories,  but  not  the  other 
types  of  FFRDCs.  Some  agency  officials  stated  that  there  would  be 
benefits  to  sharing  such  best  practices. 


Conclusions 


All  federal  agencies  that  sponsor  FFRDCs  are  subject  to  the  same  federal 
regulations,  and  each  agency  included  in  our  review  has  developed  its  own 
processes  and  procedures  to  ensure  compliance  and  conduct  oversight  of 
its  FFRDCs.  For  the  most  part  the  differences  in  approaches  are  not  of 
great  consequence.  In  at  least  one  key  area,  however,  the  different 
approaches  have  the  potential  to  produce  significantly  different  results. 
Specifically,  while  all  FFRDCs  are  required  to  address  organizational 
conflicts  of  interest,  only  DOD  and  DOE  have  requirements  that  their 
FFRDC  contractors  address  specific  areas  of  personal  conflicts  of  interest 
of  their  employees.  In  light  of  the  special  relationship  that  FFRDCs  have 
with  their  sponsoring  agencies,  which  often  involves  access  to  sensitive  or 
confidential  information,  it  is  critical  not  only  that  the  FFRDC  as  an  entity 
but  also  that  employees  of  the  entity  in  positions  to  make  or  influence 
research  findings  or  agency  decision  making  be  free  from  conflicts. 
Lacking  such  safeguards,  the  FFRDC’s  objectivity  and  ability  to  provide 


58Department  of  Energy,  Report  of  the  External  Members  Best  Practices  Working  Group, 
The  Laboratory  Operations  Board,  Management  Best  Practices  for  the  National 
Laboratories,  September  9,  2003. 

o9GAO,  Results-Oriented  Government:  Practices  That  Can  Help  Enhance  and  Sustain 
Collaboration  among  Federal  Agencies,  GAO-06-15  (Washington,  D.C.:  Oct.  21,  2005). 
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impartial,  technically  sound,  objective  assistance  or  advice  may  be 
diminished.  The  two  agencies  with  the  most  experience  sponsoring 
FFRDCs  have  recognized  this  gap  and  have  taken  steps  to  address 
personal  conflicts  of  interest.  These  steps  are  consistent  with  our  recent 
recommendation  to  DOD  that  highlighted  the  need  for  personal  conflicts- 
of-interest  safeguards  for  certain  contractor  employees.  The  other 
agencies  included  in  our  review  of  FFRDCs  could  benefit  from  additional 
protections  in  the  area  of  personal  conflicts  of  interest.  Currently, 
although  DHS  and  HHS  have  policies  that  generally  require  their  FFRDC 
contractors  to  implement  such  safeguards,  they  lack  the  specificity  needed 
to  ensure  their  FFRDC  contractors  will  consistently  address  employees’ 
personal  conflicts  of  interest. 

Conflict-of-interest  requirements  is  only  one  of  several  areas  where 
agencies  that  sponsor  FFRDCs  can  learn  from  each  other.  Other  areas 
include  the  use  of  effective  and  efficient  oversight  mechanisms  such  as 
incentive  and  award  fees,  obtaining  competition,  and  conducting 
comprehensive  reviews.  In  the  absence  of  established  knowledge-sharing 
mechanisms,  however,  agencies  may  be  missing  opportunities  to  enhance 
their  management  and  oversight  practices.  Sharing  knowledge  among 
agencies  that  sponsor  FFRDCs,  as  has  been  done  informally  in  some 
instances,  could  help  to  ensure  that  agencies  are  aware  of  all  the  various 
tools  available  to  enhance  their  ability  to  effectively  oversee  their 
FFRDCs. 


Recommendations  for 
Executive  Action 


•  that  the  Secretary  of  Health  and  Human  Services  review  agency 
policy  regarding  personal  conflicts  of  interest  for  its  sponsored 
FFRDC  and  revise  as  appropriate  to  ensure  that  this  policy 
addresses  all  personnel  in  a  position  to  make  or  materially 
influence  research  findings  or  agency  decision  making. 

To  improve  the  sharing  of  oversight  best  practices  among  agencies  that 
sponsor  FFRDCs,  we  recommend  that  the  Secretaries  of  Energy,  Defense, 
Homeland  Security,  and  Health  and  Human  Services,  which  together 


To  ensure  that  FFRDC  employees  operate  in  the  government’s  best 
interest,  we  recommend 

•  that  the  Secretary  of  Homeland  Security  revise  agency  policies  to 
address  specific  areas  for  potential  personal  conflicts  of  interest 
for  FFRDC  personnel  in  a  position  to  make  or  materially  influence 
research  findings  or  agency  decision  making;  and 
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sponsor  the  vast  majority  of  the  government’s  FFRDCs,  take  the  lead  in 
establishing  an  ongoing  forum  for  government  personnel  from  these  and 
other  agencies  that  sponsor  FFRDCs  to  discuss  their  agencies’  FFRDC 
policies  and  practices.  Areas  for  knowledge  sharing  could  include,  for 
example,  implementing  personal  conflicts  of  interest  safeguards  and 
processes  for  completing  the  justification  reviews  prior  to  renewing 
sponsoring  agreements,  among  others. 


Agency  Comments 
and  Our  Evaluation 


The  Departments  of  Health  and  Human  Services  and  Homeland  Security 
concurred  with  our  recommendation  that  they  revise  their  conflict  of 
interest  policies.  In  addition,  the  departments  of  Defense,  Energy,  and 
Homeland  Security  all  concurred  with  our  recommendation  to  establish  a 
forum  to  share  best  practices,  while  HHS  is  considering  participation  in 
such  a  forum.  We  received  letters  from  Defense,  Energy,  and  Health  and 
Human  Services,  which  are  reprinted  in  appendixes  III,  IV,  and  V, 
respectively.  In  addition,  the  departments  of  Health  and  Human  Services 
and  Homeland  Security  provided  technical  comments,  which  we 
incorporated  where  appropriate. 


As  agreed  with  your  office,  unless  you  publicly  announce  the  contents  of 
this  report  earlier,  we  plan  no  further  distribution  of  it  until  30  days  from 
the  date  of  this  report.  We  then  will  provide  copies  of  this  report  to  the 
Secretaries  of  Defense,  Energy,  Health  and  Human  Services  and  Homeland 
Security  and  other  interested  parties.  In  addition,  this  report  will  be  made 
available  at  no  charge  on  the  GAO  Web  site  at  http://www.gao.gov. 
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If  you  or  your  staff  have  any  questions  about  this  report,  please  contact  us 
at  (202)  512-4841  or  woodsw@gao.gov  or  (202)  512-9846  or 
mittala@gao.gov.  Key  contributors  to  this  report  are  acknowledged  in 
appendix  VI. 


William  Woods 
Director 

Acquisition  and  Sourcing  Management 


Anu  Mittal 
Director 

Natural  Resources  and  Environment 


Page  35 


GAO-09-15  Federal  Research 


Appendix  I:  Objectives,  Scope,  and 
Methodology 


To  conduct  this  review,  we  chose  a  nongeneralizable  sample  of  four  of  the 
nine  federal  agencies  that  sponsor  FFRDCs:  the  departments  of  Energy 
(DOE)  and  Defense  (DOD)  have  the  longest  histories  in  sponsoring 
federally  funded  research  and  development  centers  (FFRDCs)  and 
sponsor  the  most — 16  and  10,  respectively;  the  Department  of  Homeland 
Security  (DHS)  has  the  2  most  recently  established  FFRDCs;  the 
Department  of  Health  and  Human  Services  (HHS)  has  1  FFRDC 
laboratory.  From  the  collective  29  FFRDCs  that  those  four  agencies 
sponsor,  we  selected  a  nongeneralizable  sample  of  8  FFRDCs  that 
represented  variation  among  the  type  of  operating  contractor,  including 
some  operated  by  universities,  some  by  nonprofits,  and  some  by  private 
industry.  Within  DOD  and  DHS,  we  chose  FFRDCs  that  represent  the 
variation  among  types  these  two  agencies  sponsor,  while  DOE  and  HHS 
only  sponsor  laboratory  type  FFRDCs.  See  appendix  II  for  the  FFRDCs 
included  in  our  case  study. 

To  identify  sponsors’  contracting  and  oversight  methods  at  the  four 
agencies  in  our  case  study,  we  interviewed  federal  department  officials  at 
each  office  that  sponsors  FFRDCs  as  well  as  offices  that  have  contractor 
management  roles  and  audit  roles:  (1)  DOE’s  Office  of  Science,  National 
Nuclear  Security  Administration,  Office  of  Energy  Efficiency  and 
Renewable  Energy,  Office  of  Environmental  Management,  Office  of 
Nuclear  Energy,  and  Office  of  Inspector  General;  (2)  DOD’s  departments 
of  the  Navy,  Air  Force,  and  Army;  Office  of  the  Secretary  of  Defense; 
Office  of  Acquisition,  Technology,  and  Logistics;  Defense  Contract  Audit 
Agency;  and  the  Defense  Contract  Management  Agency;1  (3)  HHS’s 
National  Institutes  of  Health,  National  Cancer  Institute,  and  National 
Institute  of  Allergy  and  Infectious  Diseases;  and  (4)  DHS’s  Directorate  for 
Science  and  Technology.  In  addition,  we  obtained  and  analyzed  federal 
and  agency  policies  and  guidance,  contracts  for  the  FFRDCs  in  our  case 
studies  and  other  supporting  documentation  such  as  performance  and 
award  fee  plans,  sponsoring  agreements  (when  separate  from  contracts), 
and  a  variety  of  audits  and  reviews.  While  we  did  not  assess  the 
effectiveness  of  or  deficiencies  in  specific  agencies’  controls,  we  reviewed 
agency  documentation  on  incurred  cost  audits,  general  auditing  controls, 
single  audits,  and  audited  financial  statements.  We  also  obtained  and 
analyzed  funding  data  from  sponsoring  agencies  as  well  as  from  the 
National  Science  Foundation  (NSF),  which  periodically  collects  and 


'We  did  not  meet  with  the  National  Security  Agency  since  its  FFRDC’s  work  is  classified, 
and  it  was  not  included  in  our  case  study. 
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Appendix  I:  Objectives,  Scope,  and 
Methodology 


reports  statistical  information  regarding  FFRDCs,  such  as  their  sponsors, 
category  types,  contractors,  and  funding.  While  we  did  not  independently 
verify  the  data  for  reliability,  we  reviewed  the  NSF's  methodology  and 
noted  that  it  reports  a  100  percent  response  rate,  no  item  nonresponse, 
and  no  associated  sampling  errors. 

For  FFRDCs  in  our  case  study,  we  conducted  on-site  visits,  interviewed 
key  contractor  administrative  personnel,  and  obtained  information  and 
documentation  on  how  they  meet  sponsoring  agencies’  research  needs  and 
adhere  to  policy  guidance.  We  observed  examples  of  the  types  of  research 
the  FFRDCs  conduct  for  their  sponsors  and  obtained  and  analyzed 
documentation  such  as  contractor  ethics  guidance  and  policies, 
performance  plans,  and  annual  reports. 

To  obtain  the  perspective  of  the  government  contracting  community,  we 
met  with  high-level  representatives  of  the  Professional  Services  Council,  a 
membership  association  for  companies  that  provide  services  to  the  U.S. 
federal  government. 
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Appendix  II:  List  of  38  Federally  Funded 
Research  and  Development  Centers 


[Italics  indicates  the  eight  FFRDC  case  studies  included  in  this  review.] 

Agency /  dept/office  of 
primary  sponsor 

Name  of  FFRDC 
location 

Contractor 
type  of  contractor 

Type  of  FFRDC 

Defense 

Department  of  the  Air  Force 

Aerospace  Center 

El  Segundo,  Calif. 

Aerospace  Corporation 

Nonprofit 

Systems  engineering  and 
integration  center 

Department  of  the  Army 

Arroyo  Center 

RAND  Corp. 

Studies  and  analyses  center 

Santa  Monica,  Calif. 

Nonprofit 

Office  of  the  Secretary  of 
Defense 

C3I  [Command,  Control, 
Communications,  and 
Intelligence]  Center 

MITRE  Corp. 

Systems  engineering  and 
integration  center 

Bedford,  Mass.,  and  McLean, 
Va. 

Nonprofit 

Department  of  the  Navy 

Center  for  Naval  Analyses 

CNA  Corporation 

Studies  and  analyses  center 

Alexandria,  Va. 

Nonprofit 

Office  of  the  Secretary  of 
Defense 

Institute  for  Defense  Analyses 
Studies  and  Analyses  Center 

Institute  for  Defense  Analyses 

Studies  and  analyses  center 

Alexandria,  Va. 

Nonprofit 

National  Security  Agency 

Institute  for  Defense  Analyses 
Communications  and 

Computing  Center 

Alexandria,  Va. 

Institute  for  Defense  Analyses 

Nonprofit 

Research  &  development  lab 

Department  of  the  Air  Force 

Lincoln  Laboratory 

Lexington,  Mass. 

Massachusetts  Institute  of 
Technology 

University 

Research  &  development  lab 

Office  of  the  Secretary  of 
Defense 

National  Defense  Research 
Institute 

RAND  Corp. 

Studies  and  analyses  center 

Santa  Monica,  Calif. 

Nonprofit 

Department  of  the  Air  Force 

Project  Air  Force 

RAND  Corp. 

Studies  and  analyses  center 

Santa  Monica,  Calif. 

Nonprofit 

Department  of  the  Army 

Software  Engineering  Institute 

Carnegie  Mellon  University 

Research  &  development  lab 

Pittsburgh,  Penn. 

University 

Energy 

Office  of  Science 

Ames  Laboratory 

Ames,  Iowa 

Iowa  State  University  of  Science 
and  Technology 

University 

Research  &  development  lab 

Office  of  Science 

Argonne  National  Laboratory 

University  of  Chicago 

Research  &  development  lab 

Argonne,  III. 

University 
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Appendix  II:  List  of  38  Federally  Funded 

Research  and  Development  Centers 

Agency/  dept/office  of 
primary  sponsor 

Name  of  FFRDC 
location 

Contractor 
type  of  contractor 

Type  of  FFRDC 

Office  of  Science 

Brookhaven  National  Laboratory 
Upton,  N.Y. 

Brookhaven  Science 

Associates,  Inc. 

Nonprofit 

Research  &  development  lab 

Office  of  Science 

Ernest  Orlando  Lawrence 
Berkeley  National  Laboratory 

University  of  California 

Research  &  development  lab 

Berkeley,  Calif. 

University 

Office  of  Science 

Fermi  National  Accelerator 
Laboratory 

Universities  Research 
Association,  Inc. 

Research  &  development  lab 

Batavia,  III. 

University 

Office  of  Nuclear  Energy 

Idaho  National  Laboratory 

Battelle  Energy  Alliance,  LLC 

Research  &  development  lab 

Idaho  Falls,  Idaho 

Nonprofit 

National  Nuclear  Security 
Administration 

Lawrence  Livermore  National 
Laboratory 

University  of  California 

Research  &  development  lab 

Livermore,  Calif. 

University 

National  Nuclear  Security 
Administration 

Los  Alamos  National  Laboratory 

Los  Alamos,  NM 

Los  Alamos  National  Security, 
LLC 

Industry 

Research  &  development  lab 

Office  of  Energy  Efficiency  and 
Renewable  Energy 

National  Renewable  Energy 
Laboratory 

Golden,  Colo. 

Midwest  Research  Institute; 
Battelle  Memorial  Institute; 
Bechtel  National,  Inc. 

Nonprofit 

Research  &  development  lab 

Office  of  Science 

Oak  Ridge  National  Laboratory 

UT-Battelle,  LLC 

Research  &  development  lab 

Oak  Ridge,  Tenn. 

Nonprofit 

Office  of  Science 

Pacific  Northwest  National 
Laboratory 

Battelle  Memorial  Institute 

Research  &  development  lab 

Richland,  Wash. 

Nonprofit 

Office  of  Science 

Princeton  Plasma  Physics 
Laboratory 

Princeton  University 

Research  &  development  lab 

Princeton,  N.J. 

University 

National  Nuclear  Security 
Administration 

Sandia  National  Laboratories 

Albuquerque,  NM 

Sandia  Corporation 

(subsidiary  of  Lockheed  Martin 
Corp.) 

Industry 

Research  &  development  lab 

Office  of  Environmental 
Management 

Savannah  River  National 
Laboratory 

Westinghouse  Savannah  River 
Co. 

Research  &  development  lab 

Aiken,  S.C. 

Industry 
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Appendix  II:  List  of  38  Federally  Funded 

Research  and  Development  Centers 

Agency/  dept/office  of 
primary  sponsor 

Name  of  FFRDC 
location 

Contractor 
type  of  contractor 

Type  of  FFRDC 

Office  of  Science 

Stanford  Linear  Accelerator 
Center 

Leland  Stanford,  Jr.,  University 

Research  &  development  lab 

Stanford,  Calif. 

University 

Office  of  Science 

Thomas  Jefferson  National 
Accelerator  Facility 

Jefferson  Science  Associates, 
LLC 

Research  &  development  lab 

Newport  News,  Va. 

University/Industry  Partnership 

Health  and  Human  Services 

National  Institutes  of  Health, 
National  Cancer  Institute 

National  Cancer  Institute  at 
Frederick 

Frederick,  Md. 

SAIC-Frederick 

(wholly  owned  subsidiary  of 
Science  Applications 
International  Corp) 

Research  &  development  lab 

Industry 

Homeland  Security 

Under  Secretary  for  Science  & 
Technology 

Homeland  Security  Institute 
Arlington,  Va. 

Analytic  Services,  Inc. 

Nonprofit 

Studies  and  analyses  center 

Under  Secretary  for  Science  & 
Technology 

National  Biodefense  Analysis  & 
Countermeasures  Center 

Battelle  National  Biodefense 
Institute 

Research  &  development  lab 

Frederick,  Md. 

Nonprofit 

National  Aeronautics  and  Space  Administration 

Jet  Propulsion  Laboratory 

Pasadena,  Calif. 

California  Institute  of 

Technology 

University 

Research  &  development  lab 

National  Science  Foundation 

National  Astronomy  and 
Ionosphere  Center 

Cornell  University 

Research  &  development  lab 

Arecibo,  P.R. 

University 

National  Center  for  Atmospheric 
Research 

University  Corporation  for 
Atmospheric  Research 

Research  &  development  lab 

Boulder,  Colo. 

University 

National  Optical  Astronomy 
Observatories 

Association  of  Universities  for 
Research  in  Astronomy,  Inc. 

Research  &  development  lab 

Tucson,  Ariz. 

University 

National  Radio  Astronomy 
Observatory 

Associated  Universities,  Inc. 

Research  &  development  lab 

Charlottesville,  Va. 

University 

Science  and  Technology  Policy 
Institute 

Institute  for  Defense  Analyses 

Studies  and  analyses  center 

Washington,  D.C. 

Nonprofit 
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Appendix  II:  List  of  38  Federally  Funded 
Research  and  Development  Centers 


Agency/  dept/office  of 
primary  sponsor 

Name  of  FFRDC 
location 

Contractor 
type  of  contractor 

Type  of  FFRDC 

Nuclear  Regulatory  Commission 

Center  for  Nuclear  Waste 
Regulatory  Analyses 

Southwest  Research  Institute 

Studies  and  analyses  center 

San  Antonio,  Tex. 

Nonprofit 

Transportation 

Federal  Aviation  Administration 

Center  for  Advanced  Aviation 
System  Development 

MITRE  Corp. 

Research  &  development  lab 

McLean,  Va. 

Nonprofit 

Treasury 

Internal  Revenue  Service 

Center  for  Enterprise 
Modernization 

MITRE  Corp. 

Systems  engineering  and 
integration  center 

McLean,  Va. 

Nonprofit 

Source:  GAO. 
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Appendix  III:  Comments  from  the 
Department  of  Defense 


OFFICE  OF  THE  UNDER  SECRETARY  OF  DEFENSE 
3000  DEFENSE  PENTAGON 
WASHINGTON,  DC  20301-3000 


ACQUISITION 
TECHNOLOGY 
AND  LOGISTICS 


SEP  29  2008 


Mr.  William  Woods 

Director,  Acquisition  and  Sourcing  Management 
U.S.  Government  Accountability  Office 
441  G  Street,  N.W. 

Washington,  DC  20548 

Dear  Mr.  Woods: 

This  is  the  Department  of  Defense  (DoD)  response  to  the  GAO  draft  report,  GAO-09- 15. 
“FEDERAL  RESEARCH:  Opportunities  Exist  to  Improve  the  Management  and  Oversight  of 
Federally  Funded  Research  and  Development  Centers,”  dated  September  9,  2008,  (GAO  Code 
120687). 

The  Department’s  comment  to  the  report  recommendation  is  enclosed.  The  Department 
appreciates  the  opportunity  to  comment  on  the  draft  report. 


Sincerely, 


Nancy  L.  Spruill 
Director, 

Acquisition  Resources  and  Analysis 


Enclosure: 
As  stated 
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Appendix  III:  Comments  from  the 
Department  of  Defense 


GAO  Draft  Report  Dated  September  9, 2008 
GAO-09- 15  (GAO  CODE  120687) 


“FEDERAL  RESEARCH:  OPPORTUNITIES  EXIST  TO  IMPROVE  THE 
MANAGEMENT  AND  OVERSIGHT  OF  FEDERALLY  FUNDED  RESEARCH  AND 
DEVELOPMENT  CENTERS” 

DEPARTMENT  OF  DEFENSE  COMMENTS 
TO  THE  GAO  RECOMMENDATIONS 


RECOMMENDATION:  The  GAO  recommends  that  the  Secretaries  of  Energy,  Defense, 
Homeland  Security,  and  Health  and  Human  Services,  take  the  lead  in  establishing  an  ongoing 
forum  for  government  personnel  from  these  and  other  agencies  that  sponsor  Federally  Funded 
Research  and  Development  Centers  (FFRDCs)  to  discuss  their  FFRDC  policies  and  practices. 
(Page  33/GAO  Draft  Report) 

POD  RESPONSE:  Concur.  The  Department  of  Defense  will  work  with  the  other  agencies  to 
establish  an  ongoing  forum  for  government  personnel  from  all  government  agencies  that  sponsor 
Federally  Funded  Research  and  Development  Centers  (FFRDCs)  to  discuss  their  FFRDC 
policies  and  practices. 
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Appendix  IV:  Comments  from  the 
Department  of  Energy 


Department  of  Energy 

Washington.  DC  20585 

October  1,  2008 


William  Woods 

Director,  Acquisition  and  Sourcing  Management 
U.  S.  Government  Accountability  Office 
441  G  Street,  N.W. 

Washington,  DC  20548 

Dear  Mr.  Woods: 

This  is  the  Department  of  Energy  (DOE)  response  to  the  Government  Accountability  Office 
(GAO)  Draft  Report,  GAO-09-1 5,  “FEDERAL  RESEARCH:  Opportunities  Exist  to 
Improve  the  Management  and  Oversight  of  Federally  Funded  Research  and  Development 
Centers,”  dated  October  2008  (GAO-Code  1 20687).  We  appreciate  the  opportunity  to 
comment. 

DOE  concurs  with  the  recommendation  provided  in  this  Draft  Report  as  it  relates  to  sharing 
best  practices  for  Federally  Funded  Research  and  Development  Center  (FFRDC)  oversight 
and  the  formation  of  a  forum  with  the  Department  of  Defense.  Department  of  Homeland 
Security,  and  Department  of  Health  and  Human  Services.  The  assembly  of  such  a  forum 
should  be  under  the  leadership  of  the  Department  of  Defense,  which  represents  the  largest 
procuring  agency  and  whose  statutory  exemption  to  competition  is  pivotal  in  any  discussion 
on  best  practices  and  lessons  learned. 

My  point  of  contact  for  this  issue  is  Sandra  Cover,  who  is  available  at  (202)  287- 1 344. 


Sincerely, 


Edward  R.  Simpson 
Director 

Office  of  Procurement  and 
Assistance  Management 


Printed  with  soy  mk  on  recycled  paper 
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Appendix  V:  Comments  from  the  Department 
of  Health  and  Human  Services 


iSOT'c », 

4 


DEPARTMENT  OF  HEALTH  &  HUMAN  SERVICES 


OFFICE  OF  THE  SECRETARY 


Assistant  Secretary  for  Legislation 
Washington,  DC  20201 


OCT  2  2008 


William  Woods,  Director 
Acquisition  and  Sourcing  Management 
Government  Accountability  Office 
441  G  Street  NW 
Washington,  DC  20548 

Dear  Ms.  Woods: 

Enclosed  are  the  Department’s  comments  on  the  U.S.  Government  Accountability  Office’s 
(GAO)  draft  report  entitled:  “Federal  Research:  Opportunities  Exist  to  Improve  the 
Management  and  Oversight  of  Federally  Funded  Research  and  Development  Centers” 
(GAO-09-15). 

The  Department  appreciates  the  opportunity  to  review  and  comment  on  this  report  before  its 
publication. 


SL 


Vincent  J.  Ventimiglia,  Jr.\\ 
Assistant  Secretary  for  Legislation 


Attachment 
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Appendix  V:  Comments  from  the  Department 
of  Health  and  Human  Services 


Comments  of  the  National  Institutes  of  Health  (NIH) 
on  the  Government  Accountability  Office  Draft  Report,  Opportunities 
Exist  to  Improve  the  Management  and  Oversight  of  Federally  Funded 
Research  and  Development  Centers  (GAO-09-15) 


GAO  Recommendation 

The  Secretary  of  Health  and  Human  Services  review  its  policy  regarding  personal 
conflicts  of  interest  for  its  sponsored  FFRDC  and  revise  as  appropriate  to  ensure  that  it 
addresses  all  personnel  in  a  position  to  make  or  materially  influence  research  findings  or 
agency  decision  making. 

NIH  Response 

NIH  concurs  with  the  recommendation  and  is  currently  reviewing  its  options  for  revisions 
to  its  conflict  of  interest  policy.  Although  the  GAO  report  states  that  HHS  does  not 
require  FFRDC  contractors  to  implement  personal  conflict  of  interest  policies,  NIH  R&D 
contracts  fall  under  the  tenet  of  45  CFR  Part  94.  NIH  recently  promulgated  a  standard 
contract  clause  to  reinforce  compliance  with  45  CFR  Part  94,  and  the  clause  has  been 
included  in  the  new  FFRDC  contract. 

This  regulation  requires  objectivity  in  research  by  establishing  standards  to  ensure  that 
investigators  (defined  as  the  principal  investigator  and  any  other  person  who  is 
responsible  for  the  design,  conduct,  or  reporting  of  research  funded  under  NIH  contracts 
and  spouses  and  dependents  of  investigators)  will  not  be  biased  by  any  conflicting 
financial  interest.  Prior  to  expenditure  of  fhnds,  and  on  an  ongoing  basis,  an  Institution, 
including  the  FFRDC,  must  report  to  NIH  the  existence  of  any  conflicting  interests  it  has 
found  and  provide  assurance  that  the  conflict  has  been  managed,  reduced,  or  eliminated 
in  accordance  with  the  regulation.  NIH  is  also  drafting  an  Advance  Notice  of  Proposed 
Rulemaking  (ANPRM)  to  seek  comments  from  the  public  on  whether  the  regulations 
should  be  amended. 

GAO  Recommendation 

The  Secretaries  of  Energy,  Defense,  Homeland  Security,  and  Health  and  Human 
Services,  which  together  sponsor  the  vast  majority  of  the  government’s  FFRDCs,  take  the 
lead  in  establishing  an  ongoing  forum  for  government  personnel  from  these  and  other 
agencies  that  sponsor  FFRDCs  to  discuss  their  agencies’  FFRDC  policies  and  practices. 

NIH  Response 

NIH  is  considering  this  recommendation,  including  aspects  associated  with  the  creation 
of  and  participation  in  a  forum  to  share  best  practices  for  FFRDC  oversight. 
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Appendix  VI:  GAO  Contact  and  Staff 
Acknowledgments 


GAO  Contacts 


William  Woods  (202)  512-4841  or  woodsw@gao.gov 
Anu  Mittal  (202)  512-9846  or  mittala@gao.gov 


Acknowledgments 


In  addition  to  the  individuals  named  above,  key  contributors  to  this  report 
were  John  Neumann,  Assistant  Director;  Cheryl  Williams,  Assistant 
Director;  Sharron  Candon;  Suzanne  Sterling;  Jacqueline  Wade;  and  Peter 
Zwanzig. 
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GAO’s  Mission 

The  Government  Accountability  Office,  the  audit,  evaluation,  and 
investigative  arm  of  Congress,  exists  to  support  Congress  in  meeting  its 
constitutional  responsibilities  and  to  help  improve  the  performance  and 
accountability  of  the  federal  government  for  the  American  people.  GAO 
examines  the  use  of  public  funds;  evaluates  federal  programs  and  policies; 
and  provides  analyses,  recommendations,  and  other  assistance  to  help 
Congress  make  informed  oversight,  policy,  and  funding  decisions.  GAO’s 
commitment  to  good  government  is  reflected  in  its  core  values  of 
accountability,  integrity,  and  reliability. 

Obtaining  Copies  of 
GAO  Reports  and 
Testimony 

The  fastest  and  easiest  way  to  obtain  copies  of  GAO  documents  at  no  cost 
is  through  GAO’s  Web  site  (www.gao.gov).  Each  weekday  afternoon,  GAO 
posts  on  its  Web  site  newly  released  reports,  testimony,  and 
correspondence.  To  have  GAO  e-mail  you  a  list  of  newly  posted  products, 
go  to  www.gao.gov  and  select  “E-mail  Updates.” 

Order  by  Phone 

The  price  of  each  GAO  publication  reflects  GAO’s  actual  cost  of 
production  and  distribution  and  depends  on  the  number  of  pages  in  the 
publication  and  whether  the  publication  is  printed  in  color  or  black  and 
white.  Pricing  and  ordering  information  is  posted  on  GAO’s  Web  site, 
http://www.gao.gov/ordering.htm. 

Place  orders  by  calling  (202)  512-6000,  toll  free  (866)  801-7077,  or 

TDD  (202)  512-2537. 

Orders  may  be  paid  for  using  American  Express,  Discover  Card, 
MasterCard,  Visa,  check,  or  money  order.  Call  for  additional  information. 

To  Report  Fraud, 
Waste,  and  Abuse  in 
Federal  Programs 

Contact: 

Web  site:  www.gao.gov/fraudnet/fraudnet.htm 

E-mail:  fraudnet@gao.gov 

Automated  answering  system:  (800)  424-5454  or  (202)  512-7470 

Congressional 

Relations 

Ralph  Dawn,  Managing  Director,  dawnr@gao.gov,  (202)  512-4400 

U.S.  Government  Accountability  Office,  441  G  Street  NW,  Room  7125 
Washington,  DC  20548 

Public  Affairs 

Chuck  Young,  Managing  Director,  youngcl@gao.gov,  (202)  512-4800 

U.S.  Government  Accountability  Office,  441  G  Street  NW,  Room  7149 
Washington,  DC  20548 

